The brakes line up with the rim. You should not need to adjust the brakes just to put a thinner tire on the same wheelset (unless they aren't adjusted properly in the first place). You might need a smaller tube though.