I think it will get better. Remember that the first mile you are warming up all your muscles, so take it easy. It's the same when I go for a run--the first 1/2-1 mile really sucks, but then I get in the swing of things and the rest of the run is fine.
Just keep riding!