It's a major disrespect of your feelings for him to make that expectation. He is putting himself first despite all of the hurt he has caused you. I think it's up to you to set the boundaries here if you want to make things work and don't settle or you will not be able to heal and eventually tire of this arrangement.