My single-action EDC has a safety, and I practice switching it to "Off" as an integral part of my presentation. It's switched off long before the pistol's muzzle comes up to cover the "target." Indeed, it's off long before any shoot/no-shoot decision comes up.
The key, I believe, is:
1. Switch it off very early in the draw stroke, and
2. Practice, practice, practice.