In this humbling talk, I'll describe some mistakes I've made in working in statistics and machine learning. I'll describe my original intentions, symptoms, how I eventually discovered the mistake, and possibly even a solution. The topics include mistakes in A/B testing, Kaggle competitions, data collection, and other fields. I'll also introduce some interesting statistical and machine learning counterexamples: examples where our original intuition fails, and solutions to these examples.