Take a look at the Kabar Dozier designed folders. I got a clip point hunter and its become my new EDC since I got it. Around $20 too. They're super light since the handles are don't have liners.
IMHO, this used to be THE choice under $20 (got mine for $11 shipped!

). Now that the Byrds are out, however, there is some real competition in the "cheap but not crappy" category.
In the middle category, I'm surprised that the Spyderco Delica and Native have not been mentioned yet. With some looking around, these can be had for $40-$50. I kept my D4 (and 2 Enduras), but the Native was just not for me. The Kershaw Zing is a lot of fun for a first "good" knife, and is rare at this price point for being USA made. The Leek is just fun.
In the upper end of the "first EDC" category ( <$100), there are lots of good choices. At that point, many of the Benchmade Axis locks are possible. In this bracket, I'm going to throw out Mcusta for something classy -- the first time a noob spends $100 on a knife, they might as well get something that is blatantly "nice".
When I was in that same situation about 4 years ago, I spent close to $100 on a modifed BM707 as my first "good" knife. While it is still one of my favorites, I should have started with an "entry-level" good knife, carried and used the knife for a few weeks, then gradually made larger and better-informed purchases. It is inevitable for me to try to research "the best under $xxx" when I first get into a new hobby, but so far with guns, knives, headphones, flashlights, watches, etc, I should just learn to start with the consensus entry-level choice and grow/learn from there.
Of course, you can never go wrong with a Victorinox or Wenger at any stage in your knife collecting journey. The Victorinox Tinker is one of my all-time favorites. Most of my EDC needs are still probably better served by this SAK than by the fancy single-blade locking folders I carry.
oinkage01, get a Byrd, a Benchmade Monochrome, a Kershaw Blackout, any Victorinox, or a Spyderco Tenacious. Carry it, use it often. By the time you have another $50-$100 saved up, you will have a much better idea of what you want.