Umm, I am not sure how to respond to that. Yaoi and other things are just fun hobbies. A hobby should never be more important than a person, especially if they are your significant other or family. I like reading all kinds of comics, being an otaku is a part of who I am but I would never feel like it is more important than my girlfriend. Hobbies are supposed to make us happy and entertained so of course life is better with it. But it shouldn't go to a point where you feel like it's more important than people in your life, except if the people 'important' to you are jerks who don't respect your lifestyle and privacy. ( ̄∇ ̄")
Everyone is different, and we all perceive reality depending on our experiences.
Your boyfirend doesn't have to be your top priority in life but if your not 100% comortable with your partner maybe it's time for you to be single for a while.
It's better being alone than being with an unsatisfactory partner/friends.
Wish you the best.
Just to add to the other replies, you should always be your #1 person. It shouldn't be your boyfriend/partner/friend/parent/spouse/etc. Having your partner as your #1 person leads to unhealthy dependent relationships where you're giving and giving and not getting anything back. However, an object being more important than your relationship with a person is something you should reflect on.
For me it's not even close. I think either way would be nice but I'm okay with my life as it is because yaoi is safe and always there and is a huge source of pleasure, excitement, and happiness. <3