Another vote for heated grips. My 'strom is the first bike I've had with them, will never be without them again. The beauty is they're ALWAYS on the bike, so they're there when it gets chillier than you expected. And you don't have to stop to add/remove layers, just hit a button.
My riding pants are very heavy, so legs are protected from the cold. And when it's hot, they're protected from engine heat. I've ridden in them off road in 90-degree heat with the liners in, and didn't mind. My legs aren't doing much work on the bike, so bundling them up doesn't really bother me. But I generally run cool, YMMV.
I use layers on my torso of course, but rarely have to stop to add/shed.
Ghost Garage: 03 SV650(Stolen-Recovered-Totaled); 82 Seca 750; 86 Concours(Crashed-Totaled); 82 Seca 550; 82 YZ125