Then you need this book, How to Respond to Code of Conduct Reports, by Valerie Aurora and Mary Gardiner. It’s free! My first thought was that wouldn’t this deserve a short pamphlet, at best? But no — it’s incredibly thorough, explaining all the hows and whys of codes of conduct, giving examples and showing the advantages, and also why you’re going to get screwed if you don’t implement one. Since it’s free and comprehensive, you have no excuse for ignoring it…and if you do ignore it, it just means you’re going to have a poorly managed conference.
It also has links to other resources, like this article, No more rock stars: how to stop abuse in tech communities. Oy, but that one resonates. Not just for tech communities, but atheist/skeptical communities — we have a plague of “rock stars” who suck resources and may also draw valuable attention to events and movements, until ultimately and seemingly invariably, they turn into black holes of bad PR. Read it before you start inviting speakers.