Tri Girl, I found that in the process of getting back to be as fast as I used to be, I did it by giving up all expectations of doing it. In other words, I stopped trying, and focusing on other stuff. Getting a 2nd bike made for slower riding, with lots of stuff on it (pannier, 2 lights, computer) gave me a reason to do lots of little errand rides and some destination rides where I wanted to to be able to walk around (i.e., not be wearing my road shoes).
Last year, I had a difficult season on the bike. I felt old and slow and had more bad days than good. This year, after a couple of months, I found that with just a little trying, my speed is almost where it was before all of my medical issues started. I look forward to riding my road bike because it's not the only thing I do. Besides riding my hybrid around town, I also started running, again, with no expectations of speed or accomplishment.
I also ride with a couple of people who are slower than me, so except for my DH and the rides I do alone, my trying to be fast isn't happening every time I get on a bike. The only group I ride with is a group that is more "smell the roses," even though there are a lot of very fit people in the group.
So, while I admit I like to improve my riding, I have stopped trying to "train." To put it in perspective, what we do is more than what 95% of people do (at least in the U.S). Have fun and enjoy yourself!