I'd say since it has already been several weeks and you have not made contact he may have forgotten about the invite. If you see him again and he brings it up, you could just say "BF and I are planning a ride on Saturday, want to join us" then he knows you aren't single and he may or may not show up. If he shows up, then you know he just wanted a riding buddy, if not, maybe he wanted more.