The Random Questions thread

Wouldn’t it be “for convenience’s sake”? The apostrophe hanging out there doesn’t make sense, as it’s not something like “the dogs’ house” (meaning multiple dogs).