You sound like me.Most of the "general" public are generally ignorant; therefore, I don't care what they think. But that's just me - YMMV...
I dress how I want.
I wear beat up shoes, old shirts etc.
It's not like I don't have the money to get new stuff, I just don't care what other people think of me.
I don't care if someone doesn't like my knife. I'm not breaking any laws. Get over it.
But luckily, my are is full of hunters and outdoors men so I've NEVER had someone get scared.
Stupid comments, yes, but no fear.