What are you eating before you ride? Also, depending on how far you ride, are you eating on the bike? I've never heard of a stomach burning before.
Usually pasta, since I know most soccer players eat that before a match. I snack on carrots and sometimes dried beef strips on longer rides, and of course drink plenty of water along the way. I can't find anything on burning either!