I am prone to hypoglycemia if I don't fuel before and during a ride - and sometimes this has happened on very short rides if I haven't eaten in the preceding few hours. Your experience sounds familiar, I think Zoom is right - you need more food. I know what would happen to me if I did that kind of ride on a small breakfast and little food during - but of course all of our bodies are different...