Some very good points ^.
I'll put it this way- The fears of others might dictate their actions, but I won't let the fears of others dictate my actions.
Furthermore, I see a big difference between having a "social conscience", and outright conformity and submission to the irrational fears of others. To indulge and capitulate to the irrational fears of others does not benefit them, or society, and it certainly does not benefit me. To deny ones self a lawful right that one wishes to exercise for fear that it might upset others is the very death of freedom.
I am polite, courteous, and treat everyone I encounter with the same level of basic respect. But I'm not going to live my life based on what may or may not cause other people to become fearful. Heck, a lot of people are afraid of leather-clad bikers. Some might have a panic attack if they find themselves trapped in a confined space with one (like an elevator). But that doesn't mean I'm going to stop riding motorcycles and wearing leather.
Instead, I smile at people, I engage people in a friendly manner, and I don't do anything to cause anyone to have any rational reason to be afraid of me. And in all the years of openly carrying my "big, black, evil" fixed-blade, not a single person has ever freaked, or had a heart attack, or called the police after seeing my knife, or seeing me take it out to cut something (pictured below is what they see, minus my disarmingly handsome face).