I loved that green vinyl patent change purse that fit so discreetly on my belt, carrying my cash close to my body and leaving my hands free for whatever I was doing at the time! And oh how my heart broke when it finally gave up the ghost!
Now admittedly, the belt bag is a problematical fashion accessory - it isn't easy to wear with grace.
But folks continue to try to come up with a good version of this handy bag. Check out Flote bags on EBags.com:
Flote
A couple of my favs:

This bag is made of textured Italian leather and I love the color!

Made of smooth calfskin leather, it has a nice,tailored look.

Made of heavy cotton canvas and a bit thinner than the first two, this could be a great, with jeans, errand running bag!
All the above bags have back clips that allow you to clip them to your belt.
EBags is offering all the above for 20% off. So if you've been looking for a bit more bag convenience but something more stylish than the much maligned fanny pack, the Flote bags might just fill the bill!