You might want to consider looking for a new psychiatrist. They shouldn't be telling you what to do - especially not when it comes to major life decisions. IMO, that's not their job. Their job should be helping you to develop strategies to manage your condition and find answers for yourself.

I have had two different psychologists over the years tell me to leave a partner. The first one was spot-on, and even though it really wasn't her place to tell me to leave my (now ex-) boyfriend, she was right. The guy was a narcissist. BUT, I had to find my own path to that decision.

The second told me to leave my current boyfriend, about 5 months ago. Admittedly things were a bit shaky at that time with my guy, but I decided to hang in there (he has PTSD, so it took him a while to work up the courage to trust me), and now things are going well. I never went back to either psychologist. Even though I now understand why they gave the advice they did - both were concerned for my mental health, and both felt that these relationships were likely to increase my anxiety (which is true). The second psych said she had experience in dealing with PTSD, but she clearly knew nothing about the reality of being in a relationship with someone who has it. Kicked them both to the curb.