To speed things up, try using a solution of baking soda rather than it's paste. Alternatively you may like to use a solution of warm water mixed with some salt and/or freshly squeezed lemon juice. In both instances, best to leave the rubber portion soaked overnight.
Depending on the material...