Explain the multiple comparisons problem and its implications. What methods exist to control for it, and what are the trade-offs between them?

Sample answer preview

The multiple comparisons problem arises when performing many statistical tests simultaneously. Each test has some probability of producing a false positive, and when you conduct many tests, the probability of at least one false positive increases dramatically.