Are these linear pull (V) brakes or cantilevers? Do you mean the pad is close to the rim or dropping downwards towards the tire? Having a pad rubbing on the tire can do a lot of damage to the tire.

If it is simply the pad close to the rim with cantilevers, you can try just rotating the brake a bit on the bolt and see if it will stay there. If not, you need to adjust them. If all of this is sounding like Greek, take it to your LBS. If they have the time, they may be able to readjust in about 10 seconds.