I think a medium makes the most sense. I checked and mine vest is a medium and when comparing it to my medium Shaks, it's almost identical in the body in terms of size. I obviously can't compare shoulders/sleeves though...
Anyway, I think you'll be good on size AND I think you'll really like it!