Different epoxies, pressure used, fabrics, etc have different weaves to them. Current told me that the texture depends on their fabric supplier, so one color from one supplier may feel different than the same color from another supplier.
The dress shirt will have a lot less texture to it since they are typically a much finer weave. When mycarta is fresh pressed and not shaped, it will often be smooth on both sides as yours looks. It will be very soft and fluffy dust wise when you work it and the surface like a cotton ball until you get up into the finer grits and then it will start to feel harder. Wet sanding works great on home made micarta as well as sharp belts and light pressure. It will look bad at first, but keep going to 120 and 220 and you will usually see a big improvement!
The epoxy fills in the gaps and flows more than a prepeg will. Think of a sponge submerged in water and then the water frozen; the pores would be filled in. But if you take a sponge and soak it in the water, let the excess out and freeze it, there will be more texture. The prepeg is fabrics with the resins already in the fabric at certain ratios, so there isn't as much excess to squeeze out under pressure and heat to cure to fill in all of the gaps. Some prepeg may have more resin than others. Thicker material may have more, thinner may have less or vice versa!
I think the epoxy resins fill in the voids/texture a lot more than the phenolic resins do? G10 has a lot less "texture" to it than Micarta does even though the weave is more open looking/coarser. G10 often uses epoxy resin, as does carbon fiber IIRC, (and most home made mycarta products) but real micarta uses phenolic resin, which gives a different texture. Micarta made with epoxy resin will be different feeling, too. I believe Current did some micarta with epoxy resin and it was a way different product than with phenolic resins! I think they tried paper with the phenolic resin and some with epoxy resins?
If you sand or bead blasted your handle material, you would probably see/feel more texture since the epoxy w/o fibers in it will be a bit weaker and remove quicker. Or if you used a hard backer to sand the material or soft backer. Think of the fabric fibers as re bar in concrete; it reinforces the material. So if you bead blast burlap, you will probably have a more coarser feeling product than if you bead blasted canvas or linen or duck cloth since the epoxy between the fibers would be weaker and be removed quicker. Take some of the hardened epoxy squeeze out from your material and shape it on the belt sander. Bet it works a LOT different than the fabric material!