I'm running stock tires and keep 37psi in the front. I do 98% paved.
It gets way squirrelly in the gravel, especially 2-up.
Lowering front tire pressure to 20 or 25 helps a lot.
If I was going to do much gravel, I would definitely go with a more aggresive tire.
You might also raise your front forks a little.