In formal or academic writing I've never had occasion to use "hopefully" at all and in conversation I am more likely to use "we can only hope.'

I dislike "hopefully" as much as I dislike "I feel..." used in any context other than disclosing feelings.