Don't do it!!!!
As you say it will completely kill the handling of the car. Besides they are made from alloy and probably won't last 5 minutes in an off-road car. I know they have plastic covered pins for the driveshafts, but I doubt they'll do much to save the alloy diff.