Any other lower class bros have trouble fitting in?

I guess the nicest way to describe myself and my family is we're blue collar, although we've been called worse. I've had trouble at past jobs in doctors offices for talking too "hood" or cursing too much (I guess I said shit a few times). One of my exes who was from a very wealthy and affluent family got me to tone it down a bit and tried to change me more into a preppy type gay. And for a while there it worked and I was able to make more gay friends, even after my ex and I split. But over time I've returned to my roots and had a realization that this is who I am and if other people think I'm too trashy or hood than so be it. But I feel like now I'm back to having a hard time making friends with gay guys. I get along great with other "blue collar" men but most turn out to be straight and sometimes i want to talk about things straight men can't relate to. I just feel like a lot of gay men I've met so far just are out of touch with lower class guys like me. And I'm not generalizing all gay men that way, just the ones I've met so far.