I experienced that too. When you get rid of the jumping on the center pulley, the belt begins to ride the rear diff.
We (Oliv and I) made that mod on our X-5s, it works. We used a shock shaft and 2 B4 direction bearings to push the belt to the ground, between the diff and the center pulley.
I can take some pics if you want.
