You could get one of those automatic shifting hubs, then you wouldn't have to shift. I think they have an 11 speed one, but they are expensive.

Do you think you could use bar end shifters?