You are not pathetic! You're doing great! Soon you'll be reminiscing about when you were afraid to go downhill on one of those "share your accomplishment" threads.
Try coasting on the flat some more until it's comfortable, then conquer the hill when it feels right. It's not uncommon to be afraid of going downhill, but most likely, you'll think it's fun once you do it.