I live in a very small town in southern Germany.
Almost every man here carries a knife.
In fact until about 5 years ago - until the store closed -, every boy in the age of 14 received a Victorinox Spartan with his name engraved on the blade from a local store every year to their confirmation (protestant initiation). So it was clear, every man owned at least one pocket knife.
Normally I carry three knives: A Victorinox Nomad and a Ka-Bar Eskabar in my right front pocket and a noname mid sized fixed blade of about 11 cm blade length (which will soon be replaced by a BK17) in the right pocket of my jacket.
When I go hiking in the woods I have a Ka-Bar USMC in my Backpack (additionally). And I use all 3 every day. Of course I could get along with only one but it would be much less fun
.
I never had any problems although I don't hesitate to use a knife in public.
I think there are two important things to consider:
1. I always use the apropriate knife depending on the location and the task (for example when I sit on a bank at the marketplace just having bought some apples and like to peel one, for sure I will not pull out the Tweener or the USMC but the Victorinox or the Eskabar.
2. Don't make much sensation trying to conceal yourself using a knife, but just do it as if it was the most normal thing in the world (what it actually is ..) and it will feel much more normal to other people.
Almost every man here carries a knife.
In fact until about 5 years ago - until the store closed -, every boy in the age of 14 received a Victorinox Spartan with his name engraved on the blade from a local store every year to their confirmation (protestant initiation). So it was clear, every man owned at least one pocket knife.
Normally I carry three knives: A Victorinox Nomad and a Ka-Bar Eskabar in my right front pocket and a noname mid sized fixed blade of about 11 cm blade length (which will soon be replaced by a BK17) in the right pocket of my jacket.
When I go hiking in the woods I have a Ka-Bar USMC in my Backpack (additionally). And I use all 3 every day. Of course I could get along with only one but it would be much less fun

I never had any problems although I don't hesitate to use a knife in public.
I think there are two important things to consider:
1. I always use the apropriate knife depending on the location and the task (for example when I sit on a bank at the marketplace just having bought some apples and like to peel one, for sure I will not pull out the Tweener or the USMC but the Victorinox or the Eskabar.
2. Don't make much sensation trying to conceal yourself using a knife, but just do it as if it was the most normal thing in the world (what it actually is ..) and it will feel much more normal to other people.