If you stay near the middle but people behind you are faster, they will just pass you and you'll get dropped anyway.

There is no shame in being dropped. It happens to everyone. "Dropped" is my middle name. But there are some people that I am able to pass, too.

What group are you riding with? Is it a club or an LBS ride?