I'm fine with late-day workouts, but when I race in the afternoon I have the same problem. You might try a low-dose sleep aid (just on the days you need it). I use an OTC made by Tylenol without the Tylenol in it (called Simply Sleep). Doesn't cause grogginess with me and my doc is fine with me using it occassionally.