It sounds like you've been riding for quite a while and should have a good sense of road/path feel, so I would trust your instincts. Having said that, I would let the air out of the tires a bit to see if that helps and I would likely try the hill a few more times to see if I could correct my handling of the bike and become more confident on the semi-slicks. Obviously, what's good for one person is not good for the next... I do tend to live on the edge a bit and I'm comfortable with playing with things like that. So don't listen to a word I say if it doesn't ring true for you. Safety is the most important factor.
Living life like there's no tomorrow.
http://gorgebikefitter.com/
2007 Look Dura Ace
2010 Custom Tonic cross with discs, SRAM
2012 Moots YBB 2 x 10 Shimano XTR
2014 Soma B-Side SS