I don't know about you, but when I played Xbox 360, I only had to use 3 controllers, the one that came with the Xbox 360 (still works fine) modded controller (still works fine) and the one that came with the slim (still works fine.) Rubber never came off, buttons never got stuck, thumbsticks never got stuck causing you to move or anything. For the rubber coming off, I don't know if you're pushing on them really fast and scraping them or what but I never had mine peel off or anything. Don't know if getting food or drinks on your controller can make that stuff happen, as some people will eat/drink while using the controller, but I never did and never had a problem with my controllers.

I have never had a problem with any of my controllers except the one i smashed into the ground