I believe that what you are describing is a common sentiment shared by all collectors. Collecting anything is a fringe activity and an individual pursuit. Let’s face it, most of the crowd would rather be socializing, listening, drinking, eating, dressing, driving, thinking and speaking only whatever happens to be commonly in fad.
Collecting is more of an intellectual pursuit, an outlier activity. In accordance with our own interests we become experts in what is usually arcane subjects. We teach ourselves about the physics of using knives as tools, metallurgy, and the detailed history of long gone companies who were obscure in their own time.
We are scientist and historians, who in our own small way seek understanding and to create order. We contribute to the lore by rediscovering it and passing it down to future generations; even as we preserve the skills and physical artifacts.
That is an important and critical role. Even if it is not central to the social scene, we at least have the ability to entertain ourselves and can find challenges and self-esteem in places that most never will.