I carry mine, gives my mom piece of mind. (Mom, I'm 48 - I can take care of myself.....) It's always turned off when I'm riding.

There are pay as you go phones -I don't know much about them though.