This may have been posted here before - but a funny YouTube video about the how people in Japan are quite conditioned to bike bells....

http://www.youtube.com/watch?v=O_MphtzCOEc

I wouldn't use a whistle...... like others said, a bike isn't what people are expecting when they hear one, so though it may be loud their reaction may be quite inappropriate - like being startled into your path...