If you can't breathe easily, it's best to get things checked out right away. I had similar experiences when I was racing, and turns out I had asthma related to allergies. It was just more noticeable when I was exerting myself. Albuterol was my solution, but yours may be different.

Doctor time! That's what they're there for!