It sounds to me like you are overtraining. Are you taking at least one day completely off the bike? If you are working the point of exhaustion (temporary muscle failure) you'll need this to gain strength. Ideally the day after your longest, hardest ride would be the day to take off.