E-Brake boot removal to get to switch

I have a loose connection in my e-brake handle causing the brake light to illuminate on the dash while driving (unless I squeeze the boot). There's a leather cover over what appears to be a rubber boot underneath. How do I remove this boot to get to the wiring?

Does the handle come off, or does the boot just slide up toward the handle? I don't want to rip the rubber.

Thanks!