Having ridden in places where you leave nothing you actually want on the bike (Morocco, Italy, London etc.) and might end up in a ditch miles from nowhere (Morocco, Norway, Bradford etc.) I got into the habbit of using the pockets on the jacket and trousers. The full long range list included:
Matches, lighter, pipe
Camera
GPS
Cable lock for helmet
helmet bag
folding shopping bag and cargo net
Hip flask
Keys
Passport, money, cards, photo's of family, Vehicle documents and copies
Keys and spares
Swiss army knife, torch, lots of small batteries, whistle, hand compass
Map
Pen
Inner gloves, thermal balaclava, hat, boot liners.
Sweets
dressing pack
half litre camel back.
Baby wipes and a pack of three (

go on, bring on the comments! They are for removing bugs and emergency waterproofing, honest guv).
I always carried tools on the bike on the basis that if you got separated from the bike you wouldn't need the tools.
This little lot as stated above is lethal shrapnel if you come off. As my travel is now less extensive and the outfit has easily accessible lockable stowage i'm now trying to get back into the habit of carrying nothing except paper and the odd coin on my person. I'd heartily reccomend using a QD tank bag or a grab bag in the top of a pannier even if you do want to carry all the above. It might not feel as secure but it's got to be safer.
Andy