Okay guys, I changed the bearings and it was pretty straight forward but I still have the same problem.
Beginning to think it's not the bearings because the wheel never really shook side to side, you had to actually push the rim to get it to move. Can anyone think of anything else that could be causing this? The spokes are pretty tight so I can't imagine it could be flex from there..
Any help appreciated.