Sure, if you are actually hitting the scales. Those screws keep the scales in place, but are loose enough for the screw barrels to be taken out, and be put back in by hand. The holes in the scales can't be too tight or you couldn't get the screws back out.
I was just hammering a wooden set of scales that are riveted on, and they moved a bit. I was actually giving the wood a hammer texture, but hitting the butt made them move just a bit.
One solution for you could be to epoxy the scales to the tang. Plenty of other companies do it, I've done it to some Ontario scales, still put the screws back of course.