In my inexperience opinion; not really, in the sizes they seem to be used (around 2-8mm)
Forces acting in the plane of the blade are going to damage handle scales before they shear pins (barring some weird outliers like aluminium pins and bronze scales).
With forces acting perpendicular to the plane of the blade the glue surface area between the pin and the handle scale will be the weak point. Snapping the pin through tension will be hard.
For peened pins there may be some sweet spot in terms of clamping force provided by area under the peened part. This is a circumference to area relationship, so i'm guessing the sweet spot would be smaller than you would expect.
In general people seem to use more small pins vs fewer large pins, so it would kind of balance out. Maybe for something like a machete if you used a couple of small (2mm?) pins you could run into problems, but that would look weird. If you are using small pins use more, but you are probably using small pins because you want more for aesthetic reasons.
(bear in mind I mostly kitchen knives or the occasional display pieces, so my reaction to most hypothetical handle destroying scenarios is "why the @#%@ would you do that with my knife?")