Build the bike right and it'll be just fine! The ones that tend to break are the lightweight competition-orientated bikes. People like us (the street guys) who run bikes built for the kinda riding you're looking at don't run into breakages quite so often as we build our bikes up to take it.
Comp bikes are getting down to like, 8-9kg and getting ridden hard on the streets at that weiht, which is why frames crack, forks snap, wheels get wrecked, it's just natural. But then take my steel framed Leeson 24" for example, it weighs little under 12kgs and is pretty bombproof. Yeah I have to straighten a wheel out occasionally or change something that i've lkilled, but all in all it's built to last a lot longer and take far more than others!