Okay, here's how I'd do it, assuming you have your clothes and boots.
I'd get an 18" ontario machete. 1095 steel, made in the USA and they are about $20. They are thin and fast and bite through wood pretty well. You can even scandi grind a section of it to use for carving.
Next up I'd get my self a good quality back pack. I like to use a maxpedition pygmy falcon 2, it can be picked up for about $90. If you want to go a little more old school I'd go for the Duluth Pack Co. 'Scout Pack' which also goes for about $90.
You'll need some kind of cordage. If you ask around you find 550 cord is favored by most and with good reason. It's very strong and very cheap. 100' is about $9 anywhere it's sold. At it's most expensive maybe $20 for 100'.
Water bottle. You need at least one good bottle to store your water in. I like to carry a 27oz USGI canteen with a stainless steel mug to boil water/food in. Together you find those at a military surp. place for $10-$20. You could also do all stainless waterbottle, about the same as far price goes. It's a little hard to eat out of though. Or you can do plastic water bottle with stainless mug.
Hat. This is an important piece of gear in my opinion. It sheilds you from sun and rain. It can be used to fan a fire, carry things in etc. A military boonie hat cost about $10 at your aafes exchange and mili. surp. place. At sportsstores you can buy nice synthtic hats that breathe from brands like OP, Columbia, Northface...but those are little more expensive. If you want to go a more traditional route then Filson offers tincloth and wool hats upwards of $50.
Some sort of firekit. This is a little more personal. I'm thinking though that you will need a water proof/resistant case, at least two different ways of starting a fire and some tinder. My kit has the following:
-Jute twine, when it's fluffed out it takes a spark pretty nicely. It can be found for a buck for 100'-500' at a dollar store.
-Fire steel. I use a Light my fire 'Scout' steel. Usually $10. It throws great sparks and it comes in bright colors in case you drop it.
-REI Storm proof matches. I think it's under $10 at REI. These things are great. In wind, rain, snow these things never fail to light. Great for when you need a fire fast.
-A bic lighter. It's cheap and it doesn't leak fluid like a zippo. Sometimes I don't like screwing around and want to geat a fire going.
First aid kit. I don't carry one. Not smart, but they are little expensive to build a nice one. I know that sportsstores carry pre-made kits ranging $10-$50. They usually have things for cuts and bleeding, bee sting, aspirin and other minor stuff.
Shelter. I like to carry a poncho with grommet holes around. If you tie up the hood, you have a water proof tarp to use as shelter from the rain. Ponchos with grommets range. I know that mili. surp. ones cost about $20-$30. Eddie Bauer offers a nice one I beileve for something clost to that. Sea to Summit also carries are nice poncho in less military/tactical colors for around $30-$40.
Now for the knife(s). Some people like carrying only one dedicated bushcraft knife. I like having a 3"-5" blade. My experience with carbon steel has been good, but I've heard that people like stainless as well. There are too many to name in this category. I will name a few good ones though.
Esee Knives 'esee-4' About $90-$110. 4" cutting edge in 1095 steel. The heat treat process is really good in these knives. They take an egde great and sharpen up pretty easy. They also take almost anything that's thrown at them. Chopping, carving, batoning. Micarta handles are done wounderfully. Even when wet it's grippy.
Fallkniven 'F1, Pilot's survival knife'. $95-$115. I've never even handled one of these knives before but I hear nothing but good about them. They use Vg-10 japanese stainless steel sandwitched between softer, tougher stainless steel. It's compared to the esee-4 alot. It's handle is made of a sythetic rubber that's pretty durable.
Now if you want to do the whole scandinavian bushcraft thing, I'd visit ragweed forge. Pretty much anything scandi ground is sold there along with axes and sharpening supplies.:
www.ragweedforge.com
I hope this helps you, sorry if I left anything out. Hope you have fun bushcrafting!
Somebody's been making his wife happy.