How do I get rid of the guilt?
Guilt comes from within. Only you can get rid of it.
Recognize why you are making this change. You are trying to make your life better, everry day that you are alive. Why feel guilty about that? Life is not a bowl of cherries; it's hard at times. There are many days you have to do things you don't feel good about doing, but know they have to be done.
Guilt is not a healthy thing to hang onto, although it can be a great motivator. Use this feeling, for now, before you get rid of it completely, to motivate yourself to cleanse your life from succubi and parasites. You are already seeing the wisdom in this change. That, in and of itself, should ease your conscience.
You don't have to live to anyone else's standard but your own. When someone imposes their standard on you, it's up to you to decide whether that's something you want to live with. It's always your choice. Choose wisely.
How do you choose wisely? Make mistakes, learn, move ahead. We who have lived 50+ years have made LOTS of mistakes, and we seem wiser for it (well, some of us). So again, put more of your time in, engaging with "seasoned" people. Be as open as you are comfortable with being, and learn.
I was lucky as a teenager to spend five summers working with my Grandfather. I gained a lot of insight about life from him. While not all old people are respectable, it's pretty easy to pick out those who are, by just spending a little time with them.
Good luck in this learning process, and God bless.