Welcome to Bladeforums.
To answer your question, Kydex itself is not a very abrasive material, and a well crafted Kydex sheath does not allow the cutting edge to contact the sheath in a manner that would cause significant wear. Leather is the same way, though you may find yourself accidentally cutting the retention strap upon drawing your knife, causing wear.
In sum, the short answer is no, especially if the sheath is well made.