MIght rub the orange/brown areas with a soft pencil eraser, or a paper towel or white rag moistened with WD-40. If you see orange/brown staining on the eraser or rag/towel, that's the sort of rust you don't want. The orange oxide ('rust') is more loosely bound to the steel - so it can rub off pretty easily. It's porous and can hold moisture which will do more damage. A dark oxide 'patina' is more durable and won't harm the steel.
Sometimes the red/orange/brown in the 'patina' will be some rust hiding among the dark oxide and both can form at the same time, depending on what the steel is exposed to. So you need to keep an eye on it - the rust is more clearly recognized under magnification and BRIGHT light.