I am totally doing this. Found the ideas here on Poppies at Play
"One year my sister sent us the cutest story about a leprechaun and his treasure. The story said that if you put a treasure box out the night before St. Patrick's Day the leprechauns will leave you a little treasure. Only the leprechaun doesn't like to leave it where you put it...you must follow the trail of leprechaun dust to the spot that he hid the box! She sent us an unfinished craft treasure box with some green paint and stickers. The kids had so much fun painting and decorating their box! She also included some stuff for me the "leprechaun" to complete the mischief. She had paper shamrock confetti and a bag of hershey's treasures! I hid the box in a great spot and then created a trail out of the confetti. It was so fun that we have done it every year since!"