i believe it - i shave with a straight razor and it needs to be stropped before use whether or not it was stropped and/or sharpened when it was put away. anyone who uses a straight razor strops it before use. and it hasn't been cutting anything - just sitting there.
the thinking is that there is microscopic degree of corrosion on the edge - how could there not be with carbon, oxygen and H20? the fact is, with those three things present rust has to form. even if it's a little, it's there and it will effect how sharp the edge is. of course with a straight razor it's easily noticed - the edge is very thin and very sharp. most people wouldn't notice on a thicker blade.
IMHO you've got a very highly-developed sense of sharp!