In 'smithing it's pretty much standard practice to use the peen or rounded end for spreading and the flat for upsetting.
In other words, the flat pushes the pin down and spreads it to fill the hole, thickening the shaft of the pin, and the rounded peen or ball end spreads the end of the rivet, forming a head.
If you do use a tapered reamer, it's important to use the flat of the hammer and give it enough whack to upset or thicken the pin beneath the surface of the scale. That way you can sand the pin flush and still get holding power.
If you're just heading the pin, the ball is more efficient, but the flat of the hammer works ok too as long as it's smooth and somewhat domed, and is probably more controllable for most people and less likely to mar the scale. Think of it as a very large diameter ball end...almost any metalworking hammer should be dressed that way, with a slight dome.