It might be worth seeing your doctor about it, it may not have to do with your bike--you may be out of alignment.

I have a similar pain, but on the left hand side. I finally went to my doctor because it became so painful that some mornings I couldn't walk without a cane, stand up straight or bend over to tie my shoes. It turns out, my entire right side was jammed. So I'm in PT twice a week and they rearrange my bones and make me do core strengthening exercises for 45 minutes.