I feel every little upgrade and weight difference I make. 200 grams makes a difference.
A lighter bike is easier to move around, whether you can sidehop over bar height or not. And a bike that you love, where every part is chosen by you after how YOU want it. is surely funnier and better to ride. I think that riding becomes a tad funnier when you have new parts or even a new bike, so why not own a bike you enjoy riding? Just because your riding level doesn't match the bikes spec.
Riding should be for fun.
Changing from my mates koxx sky 3 (weighted 7,8 kilos) to my Neon bow (Around 8.5-9 kg) I could tell a big difference.
I didn't trust his bike for big gaps at all, just couldn't trust those superlight parts. But when riding natty or just "normal" street riding I could tell a big difference. Weight does matter, and if you like your bike light, then go for it!