What steel are you sharpening? And what grit of sandpaper are you using right now, with what backing under the paper? If this is the S30V mentioned in your original post, you may be seeing the difficulty of removing the coarser grit scratches with the SiC/AlOx of the paper. At finer grits, the limitations of the abrasive make it much more difficult to abrade the vanadium carbides in S30V. At coarser grits, the carbides just get plowed out of the softer matrix steel holding them, so their hardness doesn't impact it as much at that stage. At finer grits, the sandpaper will have to start abrading the carbides themselves (shaping them), to make a significant difference at the edge. Neither SiC nor AlOx will be hard enough to do that very well, if at all.
I'm bringing this up, because these are the exact same issues (see bolded and underlined text below) that limited my own efforts in trying to use SiC sandpaper to refine S30V past a certain point. Firmly affixing sandpaper to a very hard backing, like glass or smooth stone, can help it dig a little more aggressively, but the abrasive can only do so much. Diamond works much, much better at the refining stages on S30V and similar steels with high vanadium carbide content.
David