I would return the water bottle cage, you need to side loading one. One side is partly open for you to put the bottle in. This is for small framed or tight places on bikes (our tandem has them as some of the tubes make small triangles).
Are you able to post a picture of the underseat bag on? Then we cpuld see what the trouble might be?