If it is where I think it is then there is a reasonable amount of "pull" on the skin as you are riding. This is why you will need a couple of weeks off the bike - it is to allow the skin to heal properly and make a strong join, otherwise at the first decent strain, it will pop open again.

Oddly enough, you may find yourself cycling better after a two week break because your muscles will have had a good chance to recover and repair themselves.