There are a few places to see, but not a boatload. As you are passing through Rocky Mounty, stop by TwinCounty Cycle, a Suzuki dealership, and say hi to Lance Cherry, the owner. One of the nicest people I have ever met in my life and also one of the best riders. Back in the day, a hell of a Motocross racer. Also raced Harley's on the flat tracks, to include Daytona.
Just east of Rocky Mount, is a small town called Tarboro. Has a nice historic district on the east side of main st. Calvary Episcopal Church is old and beautiful, looks much older, with a cemetery full of interesting folks, to include confederate generals.
From there, you can 64 East to 13 South and head down to East Carolina and Greenville. Beautiful old campus, good places to eat nearby. Head back up 13, past 64, to Route 17 North, over to Edenton. Edenton has the largest stand of 18th century homes anywhere - more than Williamsburg, VA - and they are not reproductions but the originals that people stil live in. Beautiful setting, right on the water, where there was a great civil war naval battle at the intersection of the Chowan River and the Albemarle sound.
You could then either jump back down to 64 and head east to Manteo and Nags Head or take 17 north to 158 in Elizabeth City and take over to Barco and down to Point Harbor and into Kitty Hawk. Enjoy.