On recumbent, we have to have idlers to deal with sag. One thing that's different from what you've rigged and what is on my bacchetta is that I have a strap (looks like sheet metal) to keep the chain on the idler:

Hope this helps