Definitely get it checked out.

But I will add my experience (and more TMI ). I have internal hemorrhoids that are often exacerbated by running. They don't bleed, but I think hemorrhoids can bleed, right? I don't know what it is about running and not other exertion that makes them flare up, but there it is