A couple of months ago, I got a Smith Corona VR-60 Digital Voice Recorder from Damark for $35.
Although you can attach an external mike, you can record from your pocket quite clearly without it. It has good control over recording and play-back volume.
It has 60 minutes of internal flash memory. Your recordings can be separated into 3 files, each with however many records your overall time allows.
The display gives the time, how much recording time remains, which file you're in, which record number, how many records total in the file. Each record is date & time stamped. It also indicates how sensitive your mike is set, and how much power you've got left from its 2 AAs.
You can set alarms to beep, or play your voice announcement. The alarms can be one-time or repeating.
Of course, when you play back, you may not be at the end of the recording sequence. That's OK, it begins recording again at the next available spot, not recording over anything.
You can delete an individual record, or clear all of them at once.
It measures about 1.25" thick by 2.25" x 3.50". It has a rubber-coat. All the controls are easily accessed one-handed -- I use my right sometimes, my left usually, no problem with either. It has a good pocket clip and a wrist loop.
I literally use mine every day (so far, absolutely no sign of wear) and keep it by my bed at night for the occasional inspired thought ...