Hopefully none of that orange-nasty is inside your sheathes?
Are you trying to avoid removing patina? If that's not a concern, a little rub of Mothers, the stuff you use on chrome, in gentle circle motions will remove all the rust. In a good quantity, it will take it all the way back down to your former finest polish.
If you don't want to remove patina, the best I've been able to do is a little stone slurry in mineral oil.