Hamstring stetches might help the pain. They are good to do anyways. Keep an eye on things and if the pain increases, you might consider seeing a health care provider about it. It could also be that you are not properly fitted on your bike, and a little professional tweaking might help, too.