I have a 50cm bike, with two cages, and a pump that fits on the frame.

Holy heck I have problems even getting short water bottles out...long ones won't fit at all!

So yeah...try shorter bottles...they'll give you more of an angle to get them out.