As you hit the end with a hammer it applies force forward and a torque force. This will force the bit into the bolt and rotate the bolt. Once you crack it loose use a standard screwdriver/Allen wrench to get the screw out. Not a good application for your bolts as they are mounted on a somewhat flexible bracket and the bracket will absorb some of the hammer force. You could also bent the bracket