Yea Mark, I've had the same problem before.
I did a small skinner with 5 layers of spacer in-between the dovetailed bolsters and the stag handle (black>white>thick blue>white>black) and I had everything absolutely flush when it was done. A couple weeks later and your fingernail will hang up if you drag it from the stag to the bolster.
How aggravating!!! It makes it look as though I don't care about fit!!!
I dip in water too...so I don't know if that's it or not. I am running on a slow speed with sharp belts, but it still just seems smart to keep that piece as cool as possible.
Can anybody help us out?
Nick