you need to strengthen the muscles. You probably have life long habits that have contributed to this long before you got onto the bike.
So you are weaker on one side than the other. Postural exercises would help, strengthening your core would help too.
Many who are wiser will answer shortly.
m