My saddle has loops for a bag to be attached to it. I use one of these when I'm not commuting.

I have it behind my saddle not on my handlebars like the picture shows.

V