I had so many hassles with it (the stuff you are talking about here), I just abandoned it. But what I recommend if using as high a grit as possible to hand finish. I find that 1200 is not enough. I need to use 1500 and 2000grit, and do it WET, ie.- the handle is always dripping wet. Do that even before thinking about the buffer. The idea si to get the surface so fine that no crud can get imbedded when buffing or final finishing.
Other have told me to rub in carnauba wax before going to a buffer - that works too, but I haven't done it often enough to say for sure what the ins and outs are.
White rouge is definitely the way to go. I find it quite hard to get a completely clean buff unless I'm using a new one each time. The area around the pins will smear some but on a different thread, I learnt about washing up with warm soapy water - it works better than it sounds to get buffing crud out.
Hey, wanna buy my 6x12" plate of white and antique white linen Micarta ? Jason.