I have a big strong booty and muscular thighs but am otherwise petite. Riding had does wonders for my bum, so I think you should just take pride in your back side! Better that than a boney azz.
Who cares what other people think? We all have fault, and those are what make us interesting.