In Japan I used a similar plan and I was there during the whole Y2K scare and I wanted to be prepared just in case somebody was actually right about it. I was on the other side of the earth from home and felt I needed something, just in case.
I buried a container in the mountains near where I lived with a backpack, knife, multi-tool, bamboo saw (for shelter building), wood saw, hatchet, firestarter kit, signalling kit, etc. MRE's are hard to find in Japan so I filled up the remaining space with canned goods. The container was buried deep enough and in a tucked away space so that it was kept cool in the summer and below frost line in the winter, to preserve the food. I built it just a few miles from my house with the idea that it would be a quick place to run to if I needed to that was not too far away. I built a primitive shelter there, a cinder block barbecue, stacked a little firewood, etc. and hid it all. But I just wasn't satisfied.
Further up in the mountains where people rarely go (and is rumored to have been an old ninja training area and haunted so people tended to avoid it) I located a cave and built up defenses there. It was only accessible by foot, there was good spring water and it was fairly sheltered from the worst weather. The cave was small (about 20 or so feet deep and a few feet wide) so I hid the entrance from plain sight by transplanting small trees near the entrance and stacking small logs. I built hasty fighting positions near there (I didn't have a gun there, so it was really rather pointless, but it was fun and a learning experience). I buried caches of food, pots, wire for utility and trapping purposes, fishing kit, some basic tools, cinder blocks and grill for cooking, etc. Stacked tons of firewood and located summer and winter food sources (there were abandoned orchards not too far away, bamboo, wild game [tanuki, bear, deer, squirrels, monkeys, birds, etc], a creek with fish and scary giant salamanders, etc.). I dug out the spring and lined it with large rocks to give me more water, I built simple saw horses that could be disassembled easily and look like forest debris, but could be used for building things, a table, etc,. I cut lots of logs and saplings for building things at a later date.
This was my occassional weekend project that lasted for nearly 3 years, even after Y2K didn't materialize. It was a fun and interesting project that kept me busy, gave me a place to escape to and taught me a lot.