Your intuitions are not magic

“People who know a little bit of statistics - enough to use statistical techniques, not enough to understand why or how they work - often end up horribly misusing them. Statistical tests are complicated mathematical techniques, and to work, they tend to make numerous assumptions. The problem is that if those assumptions are not valid, most statistical tests do not cleanly fail and produce obviously false results.”

The first of what I believe will be a long series of fascinating articles from Less Wrong. A great piece on statistical correlations.

Permalink.