The most common type of handheld pull-through sharpener, which uses sharp-edged carbide inserts crossed in a scissor-like orientation, is capable of leaving edges more severely damaged than durably sharp. This is because they pinch the edge between the carbide inserts while scraping steel off in a direction parallel to the edge. The pinching effect is known to actually tear or chip a thin edge at times, if it's not used with very light pressure. To get a sense of how that happens, pull the edge of an index card through the 'V' of an open pair of sharp scissors. Note how the edge of the card can get pinched and ripped as it's drawn through. And the lengthwise scratches left on edge bevels by the carbide scrapers will leave the edge weakened and prone to quickly folding over in use. This means edges sharpened on these devices will need very frequent resharpening, which will dramatically shorten the useful life of the knife's edge, especially if chips or tears left by the device need to be removed before resharpening.
Aside from that one type of crossed carbide pull-through described above, any other type of handheld sharpener, like a pocket stone or a ceramic or diamond rod, is no worse than any other. They can be as effective or ineffective as the technique and skill of the person using them. But even when they're used with less than perfect technique, they're still much less likely to do the sort of pinching & edge-tearing damage that the crossed carbide pull-through can do.