"Constant pain means it's definitely not your gallbladder"

I went to a new Dr. this week because my previous Dr refused to do anything beyond changing me from one PPI to another, despite me saying I never actually have acid reflux symptoms.

The new Dr was listening to my symptoms, which are - Constant pressure under my right ribs that turns into a sharp stabbing pain quite often. It usually gets worse throughout the day - Lower left quadrant pain, right around belly-button height (maybe slightly higher). This comes and goes, I feel like it gets worse the longer I'm on a PPI and when I stop it tapers off, but I don't know if that's correlation or not. - Bloating/Gas

I've lost 40+lbs over the last few months because it hurts to eat. I've been to the ER twice and they did a CT scan and an Ultrasound and they all came back fine. I have a family history of gallbladder issues, even without stones, but when I told the Dr that he didn't believe me. I asked for a HIDA scan, which he ordered, but he said, "even if it comes back with a low number, I am not going to believe it". He seems to think it's impossible that it's my gallbladder because I have the pressure/pain constantly. He was leaning towards IBD, which he's also testing for, but, my question is, can it still be my gallbladder if it's constant? From what I have read here, it certainly seems like it could be/is, especially since I have a family history of the same thing....

Just looking for advice, this is my 2nd Dr, and I'm honestly not sure what to do anymore, I'm just so tired of hurting.