I have tented out pretty much once a month in northern Ohio, western PA or southern Mi since 1981. Lowest temp on a campout was -23F.
Before, 1981, my camping was mostly in California, and while it gets cold enough to kill, it does nor get below 0F.
I did live in Stony Plane Alberta for eighteen months, but never camped out. Did walk to school every day in temps as low as -42F.
That -23F night was not as bad for some as the -17F next night due to loss of loft in down sleeping bags, including a Gore-Tex shelled job. Every bag I handled Sunday morning had ice inside them since the temperature was below freezing inside the shells.
"A small amount of perspiration is continually excreted by the sweat glands in the skin. The portion that evaporates before it may be observed also contributes to insensible perspiration. Also called insensible water loss."
The primary purpose of insensible perspiration is to keep your skin moist. So the drier it is, the more insensible perspiration results.
The reality of constant insensible and/or sensible perspiration was the reason for the vapor barrier liner ("VBL") boomlet years ago. The theory was that the vapor barrier would accomplish two things: 1) by raising the humidity near you, insensible perspiration would decrease; 2) the moisture from perspiration would not reach the insulation layers of your sleeping bag. I tried it. It was warmer, but I could never get to like the clammy feeling. VBL's are still available, although not from major companies.
One expedition to the North Pole had to have new sleeping bags dropped to them due to ice accumulation inside their bags. The ice was crushing the air out of the insulation.
Here's a study if you want the science in detail:
https://arapahoeprepfair.files.wordpress.com/2011/08/frost-in-arctic-sleeping-bags-edited.pdf
Any article advocating VBL's will discuss the issue.
Obviously, breathing into the bag will make it much worse.