check local bike shops. Many of them will have weekend group rides. Not all of them are geared toward racing. After all, those who can afford the expensive bikes are those who are older and more established. Ask if they have a social group ride where its not about speed or distance.
A smart bike shop would cater to the older crowd. They are the ones who can afford the high end equipment: Ridley, Cervelo, Colnago, Trek... Ultegra, DuraAce, Chorus...