There are too many examples, pretty much all of my family is very irritable and I'm the only one who went to therapy, then there's my neighbors who aren't too nice who yell at me for just being there, I have chronic pain, I know there is nothing I can really do but I can at least tell someone about it if it's serious, I keep going through it and I don't know what's a threat anymore
Honestly? As someone who struggles with his own candid self and generally actively tries to not get too much negative feedback, I can confidently advise you, in this case, to stop putting much weight into what these particular individuals say or think about you. It is a rather difficult, perhaps even regrettable, position for a person who I suspect only wants the well being of everyone, but some situations in life call for a more flippant attitude that, make no mistake, will make you happier in the long run. Rest well knowing that you can't fix these people, and that's ok.
That regards your allegedly drunkhead neighbours. Obviously the same strategy cannot be employed with your own family, and I can't trace much of a parallel between this and my own experiences, so I will let other, better versed users potentially aid you to that end. I do hope you find your peace eventually as you seek your place in the world.