Assuming the general populace are all sheep is kind of...sheep-like isn't it?
I was worried about carrying in Canada, since legally the knife has to be visible. Mostly because I figured if I had it too concealed, and a cop still noticed, he might hassle me, and if I carried it too overtly, I might get hassled, or looked at weird anyway. I've been carrying regularly for over a year, and haven't had a single person even comment on it. I usually carry either a Kershaw Scallion, OD/black combo with a silver clip, or a CS Recon1. Two totally different knives, and yet I find the big Recon 1 blends in, and sits lower than the Kershaw. That being said, if I were to open the knife in public, the Kershaw probably wouldn't elicit the same response as if I pulled a big tactical knife.
I do try to be thoughtful about the situations I'll be in that day. I don't carry at work, or if I'm going somewhere that they might be sensitive about knives; sporting events, concerts, amusement parks etc. If I'm going to the mall, the Recon1 stays home, but I'll still bring the Kershaw. I don't try to hide my knives, and I know the effect that they might have on some people, but for the most part, I don't think many people who are afraid of knives even notice them. If someone does, they're probably far more interested in what kind it is than the negative connotations behind it.