I do pass people occasionally and the younger men frequently do *not* appreciate it. They'll do anything to pass me, even if they can't keep up.
PS, I'm not fast, just impatient when I'm on the bike path on my way someplace. I *do* call out "on your left" unless there's a considerable distance between us.