I like you man but regardless of where they've come from you have to respect that they've just moved in and don't want some annoying kids hopping about, making noise presumably, outside their house.
You're in the wrong here I'm afraid. Just go find somewhere else, don't backchat or you'll get a bad name for you and your parent(s) house. And no one wants that