I personally like having my valuables (cell phone, keys, money) right where I can see/access them while riding, so most of the time I use a waist/lumbar pack in addition to any other bag I might need for the ride.

I don't find it uncomfortable to wear one except in extreme heat, so I try to use a smaller pack when it's hot and delegate snacks, tools, etc. to another bag on the bike.