My 2 cents, since you are planning to ride on Saturday:

You will likely feel the same on Saturday whether or not you go to see your doctor. If you reschedule now, it won't be irresponsible . . . you'll still be following up, and you will have given your doctor's office plenty of notice to put someone else in that time slot.

Weather on Saturday is looking to be beautiful. Which bike would you rather ride?