In order to pursue your passion, it can really help to develop a positive environment around you. In particular, get rid of drains, things that suck the life out of you.
That could mean removing certain people from your life, leaving jobs that take everything from you and give nothing in return, or moving into a different living arrangement that doesn't constantly cause you stress.
Now, that's not to say that everything has to be perfect before you start on your journey, but it definitely helps to get rid of as many negative things as possible. I've seen people completely drained after a long day and they have nothing left to give to their passions. What are the chances that whatever strength they are able to muster will allow them to build anything more than a small hobby?