The main problem with Sableye is as you alluded to, it's frailty. It has 50/75/65 defenses... for reference Infernape, considered to be rather frail, has 76/71/71 defenses. It's best to switch it in on an immunity or after you lose a poke, and losing even one poke with stall can really hurt...