As i'm extremely lazy i also have to be very efficient to get by, so for things like these i often use a process called electrolysis, which removes only the rust and leaves the finish untouched.
You only have to set things up correctly, then sit back, relax, and check from time to time.
For knives i use an old car battery charger, a plastic tub filled with warm water, a few table spoons of cleaning soda, the suspended blade connected to the +, and a scrap piece of aluminium connected to the -
YouTube has lots of informative footage.