I assume this is an original X - 6. Before doing anything I suggest you check the two tech tips about servo mounting here:
http://www.xfactoryrc.com/rc/Tech_2wd.php
With some servos a bit of grinding is necessary to get full throw. We don't know of anybody who weakened a car enough doing this to cause breakage. That said, check frequently to be certain you take away no more material than is necessary. Most drivers need to Dremel on just one side.
This problem was solved on the Squared, and we know of nobody who has found Dremelling necessary in this area on a Squared.