As Willie said, burnishing with steel seems to work well. During my time doing leatherwork, I had a few vaguely spoon shaped burnishing tools that I used. I would actually venture to say that you could probably use an old stainless steel spoon and get a decent result.
I also agree that you want to use some older, dryer leather. Perhaps leave some in the sun for a while and see if you can get it to go crusty on you. You could also try cutting out your stack pieces, then lay them out on a cookie sheet and dry at low heat until nice and crispy.
This will also ensure that you get a nice tight stack, and it doesn't shrink on you down the road, leaving gaps.
You may also want to experiment with something such as tung oil, if given enough time to dry properly, it may let you achieve a terrific finish. That's a bit of blind guess, but I think there may be merit, based upon my experience with tung oil and wood.
IIRC, I saw a "How it's Made" on Estwing hammers/axes, and I remember them either dipping the leather handles in oil or varnish before finishing. I think that you may need some kind of surface binder to keep the fibers down and allow them to form a solid surface, depending on how porous or fine grained the leather is, and how well cured, moisture content, etc.