Depending on what temperature you are running the forge at, how efficient your burner is, and how efficiently you use your forge - most folks get from 1 to 3 pounds of propane an hour. If I had to guess an average use, a 20# tank will normally run a small forge about 6-10 hours of forging.
Tips to get better efficiency:
Manually turn down the flame when not heating the steel, or make an "idle" valve. This is a by-pass shut down that reduces the fame to a per-set minimum. It can be a simple ball valve and lever valve setup, or a more elaborate solenoid and foot pedal setup.
Insulate the forge with 2" of wool and use ITC-100 as a final coat over the satanite.
Only run the forge as hot as needed. No need to have it running like a jet engine when you are just doing some regular forging.
A blown burner is more efficient, as it can be run at a lower setting.
A bulk tank is more efficient because it is often cheaper to fill and won't freeze up. A 100# tank is the most popular because you can take it to get filled yourself, but larger tanks and getting the truck to come and fill it is often the best price in some areas. It really depends on your use and need.
As to what fuels are the most affordable, that somewhat depends on where you live and how resourceful you are. You can make your own charcoal and forge with that for very little money, but a lot more effort. If you live in a coal filed area where they have the right type of coal, that is a fuel option. Most folks find propane the vest choice for simplicity and availability. Chech around for the local prices. The big-box club stores are often as cheap as driving to the propane supplier.
There are waste oil forges that will burn almost any flammable oil ( fry oil to motor oil). These are not really beginner projects, and also require a more elaborate setup.