Going from plastic vanes to feathers will help. Feathers don't kick as hard as vanes when they hit the bow, and they correct faster in flight. It will also reduce the dynamic spine of the arrow slightly because they're lighter then vanes (hits to the right of the vaned arrows for a right hand shooter).
The bad news is it won't completely correct the problem. You still have fletching contact. The two most common causes are a too low nocking point or a misspined arrow. If most of the the damage is to the lower hen feather, or your arrows are porpoising in flight, then your nocking point is too low. Increase it 1/16" at a time. If both hen feathers are getting nailed or your arrows is fishtailing, then your arrow is misspined. The fletchings are either not getting around the riser fast enough (underspined), or they are coming back and hitting the riser (overspined). Longbows typically require a lower spined (less stiff) arrow then recurves of the same draw weight. 5-15 lbs lower is typical for modern tackle.
You can check for contact by powder testing the bow. Dust the arrowrest with talcum or foot powder and shoot a couple of arrows. Streaks in the power indicate where it's contacting.
You can check for spine by bareshafting. Strip the fletchings off of 2 or 3 arrows and wrap where they used to be with tape till the arrow balances at the same point as a fletched one. Shoot both types at the target. If the unfletched arrows impact to the left (right hand shooter) of the fletched arrows, then your arrows are too stiff (overspined). Go to a heavier point, a longer shaft, or a weaker arrow. The opposite applies to underspined arrow (impact to the right of the fletched arrow). Go to a lighter point, shorter shaft, or a stiffer arrow. Caveat that this will not work with a severely mismatched arrow (e.g. 50# arrow for a 22# bow).
Bareshafting can also be used for nocking point, but be careful because fletching contact will play games with the results. If the unfletched arrow are hitting below the fletched arrow, then your nocking point is too high. If they hit above, then your nocking point is too low.