Tipped the bars back and the bike feels completely different alot more flicky. My bars are at about 37" high but not sure I can use any more spacers would look ridiculous, going to start off with some riser bars and see if that helps and maybe a stem so I can loose all these spacers.
But I can now ride with out my arms aching, so thank you everyone for the advise.