I don't use the big ring much on my bike due to knee issues, but I have similar experience when in the small ring and smallest cog. It's that way regardless of any adjustments that are done on my derailleurs.

So I only ride in that combination for short stretches, otherwise I shift up to the big ring.