I used mountain bike shoes with my road bike for the first year or so that I had it. No one ever pointed and laughed.

I think you should wear what's comfortable. After you ride for a while you can decide if different shoes would work better for you.