If indeed you are not going to carry heavy loads then your bike is probably fine. The difference between a touring bike and a cyclocross bike is that the frame (touring)has a longer wheelbase,lower bottom bracket and longer chain stays, and of course the geometry of the frame is different. All of this contributes to the bike being able to handle much better and will be more stable. But, if you aren't going to carry panniers, then I would say go have fun!
I'm with you, although I love to race, I find the my true love is really distance!
Keep us posted as to how your bike holds up! I'm building a touring bike right now!