straightrazorplace.com would be the place to go.
I live in Denmark so i dont really know what shop to buy from in the states, but i see no problem with getting an old razor off ebay, many of the old brands are good as long as you dont buy a cheap knock-off or chinese copies.
Personally i use and old Daveso that i bought from a barber who had it on display in his window, and i have bought a new Theirs Issard that i use on a daily basis. Other good modern brands would be Dovo or Puma, but those are european brands, dont know what US brands to go for.
For soap i use Dovo and Proraso, Dovo is German and Proraso is Italian, the reason i have both was in order to try a few different brands but they are both equally good and i just switch between them for fun.
Get a decent brush, avoid bore hair and go for badger hair, no need to get the expensive badger hair like white tip, the quality is not proportional to the price in my oppinion.
My gear is:
3000/8000 waterstone
1 badger brush
1 strop with a leather and a canvas side
1 shallow coffee cup for the lather.
i like to use a pre-shave conditioner, sort of a thick lotion you rub in to your beard after washing your face, let it soak in before lathering your beard, wait a few minutes and shave. When you get the hang of it, it does not take much longer than a regular Gilette-shave, but you dont have a the same irritation that you can get with the multi-bladed razors, and you can clean/sterilize the straightrazor a lot better, and thats important to avoid irritation and infection.
Initially it a fairly large investment compared to multibladed razors but in the long run a lot cheaper.
Claus Christensen
Denmark