The higher the grit you go, the slower you'll remove metal. If you still have scratches from 180 grit, those are very deep scratches, technically you can eliminate those scratches will a 2000 grit sandpaper, but it will take a long long time, and you will go through a lot of sandpaper, maybe days of handsanding.
When you start from a low grit, 180 grit, and you go to 220 grit, you make sure that you have eliminated all the scratches from the 180 grit, because 220 grit can remove 180 grit efficiently. Repeat for higher grit. The reason Nick Wheeler tells you to go alternating 45deg is so that you can make sure you have eliminated all the scratches from the previous grit, if you just sand in the same direction, the previous scratches will hide in the current scratches.
I made a similar mistake with my very first knife, I finished the knife on a 36 grit belt before heat treat, you didn't read that wrong, 36 grit before heat treating, after heat treat, the scratches are to damn deep that it's impossible to grind out even with a belt grinder, I was still optimistic that I can hand sand everything, I went for days and wasted tons of sandpaper with little to none progress.