Wear your normal cycling clothing. Of coursed pick your closest fitting gear, but until you are worrying about shaving seconds off its not going to matter too much.
There are some free things you can do-
Don't wear gloves - this is free and cuts drag as much as a deep section front wheel....
If you don't have a frame with aero tubing, keep a water bottle in the seat tube cage (it can be empty) - also free
There are some inexpensive ones too -
Aerobars - this should be the first thing you invest in - they don't have to be fancy or expensive. Clip on's from Performance will do fine to get you started.
After this, if you find yourself loving TT'ing then think more about your equipment. Get a TT helmet (more bang for your buck than a super fancy expensive wheel set) and a skin suit. Think about a dedicated TT bike maybe, but to start out you don't have to do anything but ride.