I think if you are not in a hurry you could do it. But it would be hard for me to get through an 80 mile ride without sugar.
I had a coworker who went on a diet on the days he did not ride, he stayed away from sugar. But his come was a hilly 18 miles each direction. On those days he ate what he wanted. He did melt the excess weight away that year..