CC,

The minimum wage (and typical wage) for restaurant servers is significantly lower per hour than other workers. Their income is almost solely based on tips. If you don't feel that you should tip, perhaps you could go to places where they're not a factor of the waitservers wages, such as fast food places.