The closet I have is linens. Save for a hat that still has some mileage on it they are already stowed for this year and unlikely to come out of hibernation again 'till next April. Apart from socks and some silks winter is a time for me to use technical fabrics. Everything else is either too lumpen and heavy, not windproof, not waterproof, slow to dry, or feels like it is fermenting when it gets wet, rather like what I imagine it would be like to be trapped inside a yeast infection, or some combination of those.
That said, I figure it depends on how serious you are, how cold wet and exposed your locations are and all that. A day out on the moors shotgunning and then home to lunch here means tweed is plenty good. I don't know if there is a hemp equivalent of Barbour waxed stuff for things like that but if there is I don't envisage a problem necessarily. I'm often out lamping at night in winter wearing an old cotton parka. Nothing bad happens and I should be much more exposed doing that than the average bloke pitching up a nest for a single overnight job.