The hardest part is knowing how everything works in theory but somehow doesn't translate well when I do it.

Brakes, derailleurs and taking on/off tires off of the rims. My hands ache after a few minutes. I love disc brakes, but getting them adjusted between the pads while trying to hold the bike is really hard.