I think it's never the wrong thing to attend a service like this, even if it's only to show the family that he was known and appreciated at work. You don't have to have been a close friend to do that. OTOH, I'd probably stay close to the back so you can escape if you start to fall apart, and I would only attend the main funeral and not any graveside service (if there is one) or social gathering afterwards.
Sarah