That's why at the Shinto shrines and at many Buddhist temples you will find for sale omikuji, fortune telling slips of paper. Randomly selected, they include predictions varying from "great blessing" (dai-kichi) to... "great misfortune" (dai-kyō) (see here for the various degrees). And the tradition says that if the prediction is favorable, the omikuji should be kept, but if the prediction is bad (or not as good as you hoped for), you should fold the slip of paper and hang it on a tree or on the special stands installed around the shrine (like in my photo). That way, you may avoid the predicted bad luck and even try again - but not immediately (^_^)...
EXIF info:
Nikon D90
Lens: VR 70-300mm F/4.5-5.6G
Focal Length: 270mm
Aperture: F/5.6
Shutter Speed: 1/160s
ISO Sensitivity: ISO 320