Yep. That's what I did, I removed it because the whine 60-80 and hollowish sound on decel was just too much. No sense in paying 30k for a nice car then be ashamed to let anyone ride because it's so noisy. The radio wouldnt even dround it out.
Did you adjust the pinion angle?
The whine and clunk in my rear was gone once everything was within factory specs.