I have a Specialized Ruby Elite - the model with SRAM components. I find the ride to be ever so smooth and have never noticed any twitchiness. If a bike is twitchy, either the geometry is pretty radical or there is a mismatch between the bike size and rider size/position.
I think that those people who say the bike is "slow" may be mistaking smoothness for lack of speed.
JEAN
2011 Specialized Ruby Elite - carbon fiber go-fast bike
DiamondBack Expert - steel road bike
Klein Pinnacle - classic no-suspension aluminum MTB