Depends on which way you look at it. You are correct if you are looking through the frame when you turn that allen wrench. You'll need LEVERAGE, so get a really long allen wrench, or attach a steel pipe to it.
That's why I was planning to use the air wrench ... but a piece of pipe and a hex key would probably do the trick, if I can find a pipe