Best thing I've found for getting rust out of pits is my Dremel with a brass brush. The brass is softer than steel, but harder than rust, so it gets the crud off without affecting the steel.
If you don't have a Dremel, you might try one of those brass scrub pads you find in the cleaning section of the grocery store. Same effect, just takes more "elbow grease."