"Rubber" handles are injection molded....you have access to that? If so, I have work for you....
Otherwise, gluing and pinning is your only option and that isn't really a hot idea. They just don't hold up well. Now, spray application of bed liner might work and I have some success with that but not as a big handle material, just as a traction coating.