A very useful product I have found for removing rust is PB Blaster, sold in automotive parts stores. It neutralizes and dissolves rust, turning it into a soft gummy substance that you can scrape away with a metal softer than the knife steel (brass, or a nickel or penny). It hasn't removed the blued finish on firearms and doesn't remove the patina on old knife blades.
It will dissolve some plastics, though.