Portsmouth is an awesome small city. Lots of good restaurants and shops. I've done a ride that goes from Portsmouth to York Beach, Maine a couple of times. You can ride by the ocean (all 18 miles of NH coastline) and then head inland, where there's rolling hills and farms.
I'd also suggest the Camden area of Maine. Challenging riding, hiking, etc.