I have a candle lantern sold by the late, lamented Early Winters. It works great, is relatively safe to use and puts out a surprising amount of light. The candles are heavier than a tea light, but last a long time.

I think REI and a few other companies sell something similar, if not identical. Mine is made of aluminum with a brass cap over the candle, but I have seen all brass ones, too. The glass in mine retracts for packing which protects the glass and makes it a lot smaller.