I have a lot to say on the subject of traditional masculinity and all of that.
I relate to a lot of what you said! Growing up gay in the south/midwest (Texas and Kansas), I had that traditional Catholic upbringing that still haunts me to this day. I couldn't come out for the longest time for fear of violence, and when I finally did to my friends at school, I too was kind of the novelty kid. The punching bag to half the class, and the harmless but funny kid to the others (being gay was fine as long as you made it clear you were silly and not "predatory" in any way, which is weird to say for a middle schooler, but you know how it goes). Eventually, by proving yourself enough of the class clown and a harmless commodity, even the jocks begin to accept you.
As much as collecting can be viewed as shameful in the straight community, I do feel like being a nerd in the gay community is a whole other can of worms. Very similar in many regards, of course, but a lot of the gay stereotypes are unfortunately true. For the longest time I had trouble finding someone to date because the idea of a "nerd" may have been attractive on paper, but upon seeing what it really entailed, they couldn't head for the hills fast enough. To a lot of gay men, a "nerd" is just a ripped jock or a skinny little twink with a pair of glasses on. If you're not the typical chiseled physique who likes to party, then you're not truly part of the community. It does kinda feel like those silly high school politics all over again, just with a little more glitter mixed in. Of course, there's someone for everyone, but it's certainly not the norm; the gay community can be uniquely mean-spirited when it comes to outsiders, ironically enough.
My first serious relationship, it felt like my nerdiness was tolerated, but never truly accepted, and I hate that I cut back- and considered quitting collecting altogether- to try and please him. The things we do for love, eh? I'd convinced myself that my hobby was just a major turn-off to others, and resigned myself to a single life, but luckily, my current boyfriend and I have been together for 7.5 years, and he's just as big a nerd as I am. We actively support each other's hobbies, and even though we may not be the best of examples in terms of financial responsibility, it's that moral support that truly means the world. I never have to feel embarrassed talking about the things I love around him, and vice versa, and I know that if I tell him I'm looking for a certain figure, he won't look at me like I'm speaking a foreign language. We're definitely worried about when we do move in together, where all our stuff is gonna go, though- it's gonna be a challenge for sure.

Especially living in NY, you can have space for both, but it's gonna cost you big time. Point is- I'm very glad I didn't end up giving up collecting, as I was very close to doing. The closest thing to that I do now is holding off on or foregoing a purchase so as to be able to do things together as a couple.
And yet, even with as much support as I get from him, there's still that underlying shame. My dad used to have a saying that he apparently heard in the army, and as much as I hate the guy, it's definitely true. It goes "One 'Oh Sh*t' can knock out Ten 'Atta Boys'". Basically meaning, you can get ten compliments or do ten things right, but the moment you do one bad thing, or someone says one bad thing to you, it'll make those ten good things feel like they never existed. I kinda feel like the world at large is like that now- life can be going your way and everything is sunshine and roses, and then one (increasingly major in this day and age) thing can come along to knock it all out.