do you want a sit-on-top or a closed deck kayak? I would suggest taking some flatwater kayak lessons, including rescues and rolls. You can take the rescue and roll classes in the pool in the winter if it's offered where you live. That's a great way to learn. In the spring/summer, look for a kayak course that covers the basics plus at least some basic rescues.

Many of the outfits that teach kayaking also offer used boats and equipment for sale. After you know more about it, you can decide what you are looking for in a boat.