Welcome to Shop Talk.
You will quickly find that the fuel used in forging is a minor cost of knifemaking. The tools are where money gets spent.
An average size venturi forge will use a 20# tank of propane in about 20 hours. Smaller forges may last up to 30 hours a tank or more. These numbers are actual running time. A 5 gallon/20# tank costs something around #12-$15, so that works out to roughly between $1 and $.50 per hour.
If at all possible, build a blown burner. It is more efficient, and can be used for HT easier. The cost isn't much more than a venturi, and the savings will eventually pay for it. A good forge can be built for less than $100. With some scrounging skills and help from someone with a good shop (metal working tools and a welder), it can be done for half that.
Places to save money:
Handle material. There are many sources for free or inexpensive handles. The simple paracord wrap has worked for many new young smiths. A visit to a cabinet shop or woodworker will often get a box of "cut offs" that are great for handles. A visit to a fellow knifemakers shop almost always gets some free materials.
Tools. - You don't need $5000 in tools to get started. A few files and a stack of 3M wet-or-dry paper will work fine for knives.
The Forge. You don't need to start by forging the blades. It is a lot of fun, but in the end, all knives are stock filed and sanded. Start with some stock removal blades and when your finishing skills get developed, learn forging.
Experience. You will be much more efficient when you have more experience. Start with smaller and simpler knife projects, and as your experience/skill grows, move to more complex and larger knives. The experience of others is invaluable...and free. Posting a project plans and drawings here on BF will get it critiqued and tweaked before you make costly errors. Finding a maker in your area is also a good idea. He will have equipment, supplies, and often freebies as well as help with your knives.
Places not to save money:
Steel. - Use steel of a known alloy type. That means you actually know what it is....not suspect what it is. Buying steel from a supplier is the best way to assure the steel is the right stuff and that it is in a spheroidal condition ready for making a knife. I use Aldo Bruno, AKA The New Jersey Steel Baron.
Time. Taking the timer required to do each steep fully and properly is a must. Rushing to churn out a knife in a day or two is foolish. My answer to, "How long does it take to make a knife." is, "As long as it takes." Don't move to the next step until the last one is done right, and don't skip steps.
A lot of questions will be answered in this tutorial:
http://www.bladeforums.com/forums/showthread.php/694673-How-to-instructions-for-making-a-knife