I see no one has responded here... probably because this topic has been discussed at length.
Basically, everyone has a different opinion.
Sherline and Taig are the 2 US-made mini mills. People who have them like them. Some people (including the guy who started the Sherline company, according to his book) consider the Sherline too light for steel and stainless.
However, a few people have chimed in and say they love it.
Same with the Taig; you'll get different opinions.
For US-made, I believe the next step up is a Tormach CNC for $7k to $9k IIRC. Most people seem to consider that a fully capable machine.
Besides that, you have your imports. You could split them into 2 categories: square column and round column. Both have a moving head for the Z-axis. Most people seem to favor the square column because you don't loose your X-Y location when you change your Z. However, I've heard positive reviews of some round columns, specifically a Jet that came up in recent conversation.
The import mills are pretty much a no-brainer; the more the HP and the more the mass, the better.
Most people go with R8 collets.
I think a lot of the people here are looking to mill slots and other light duties (like you). I'm guessing that is why so many are relatively happy with the mini mills.
Check out littlemachineshop.com and cnczone.com.