It depends on what you consider to be a "non-knife" person. Some would say I'm not a "knife-person." Others would say I am. It is all relative. To most here, they don't know anyone PERSONALLY who is "into" knives as much as they are.
I have been given knives on three occasions. I was given a USMC Ka-Bar, a Spyderco Wayne Goddard folder, and a handmade skinner. I have given people guns on more than one occasion. Honestly, I did not give others the very best guns out there, but instead gave old military surplus firearms. They are inherently quality arms, but not expensive.
I would suggest giving quality knives, but not expensive knives. In addition, give traditional or historic knives, not tactical knives. This way, even if the recipient never carries/uses the knife, it is not a waste. The recipient can appreciate the knife as a historic piece or artifact, without having to "use" it.
Ka-Bars are a favorite among my friends. One of our Marine Corps buddies gave them as wedding presents to everyone. My best friends both gave knives as groomsmen gifts. Just this Christmas I gave a Bowie knife to each of my three closest friends (and I got one for myself!) They weren't the most expensive knives by any means, but they weren't something my friends were likely to buy on their own, and it was the thought that counts. Each of us has more guns and knives than anyone needs, but we like arms.
Oh, and I gave Spyderco Delicas to my wife and sister. My wife's Delica sits in our junk drawer, to be used periodically by passers-by. I don't know if my sister ever uses her knife, but it is special to her that I thought enough of her to give her a knife. She has also surprised more than a few people when she has whipped it out!
So in summary, give a quality knife, but not an expensive knife. Traditional or historical is more important than tactical.