I feel your pain, however I keep my things in a bag that I keep REAL close to me at all times and if I'm riding with friends we all put all the bags together in case we are in a public place.
However most of the time we ride in places where there's no people at all. Mostly natural or private spots.
The rest of the times I keep things inside my car and I just take the keys with me.
It's hard to ride with these ridiculous new phones on your pants nowadays.