If you feel the bike is still not straight vertically in the trainer, you may need to change one of the end/connector cups that come with it. When I felt I had a bit of a lilt, I put on the other cup provided and that fixed it.

Good Luck,
P2