You'll also want a frame pump, tire levers and the knowledge of how to change a tire in case of a flat.

Make sure you have room somewhere (in a bike bag if not your pockets) for ID/insurance card and some snacks, which you'll probably want on your longer rides.