What you are getting is a "patina" or a good type of rust. It is caused by the acid in the apple and if left alone or encouraged with more apple cutting and allowed to completely cover your blade, that is a good thing. It will help keep the "red" rust which is a bad thing from forming as long as you keep your knife blade clean and dry. A lot of people force this patina with different juices, like lemon, orange, etc in order to protect their knives from rusting.
If you do not want this protection, and want the shiny look of when it was new, you can remove it with some type of polish like Flitz or Semicrome. They are slightly abrasive and will leave your blade with a slight "sheen" to it. I have used 000 steel wool and some WD-40 to remove the patina from some knives before with good success.
Blessings,
Omar