For the drill press, hit craigslist and try to find an old one, made of metal with a heavy duty rest. Make sure it runs true. Buy some good bits and a bottle of cutting oil to go with it and some clamps for securing stock.
As for the grinder, if you are making small knives even a 1X30 will be better than nothing, but it's certainly not ideal. You're looking at around $500 for the cheapest commercial 2X72 belt grinder, but there are some craftsman 2X42 grinders that are more or less affordable. Or you can get a bench grinder to profile and rough in your bevels, then draw file them flat.
Good luck!