Do you really mean smaller diameter? If so, then as long as you're not keeping a death grip, you should be okay.
If you mean width ... then that will put your whole shoulder girdle in a different position, which has the potential to affect your neck ...