Last May, Dave at Euri.ca took at crack at expanding Gabriel Rossman's excellent post on spurious correlation in data. It's an important read for anyone wondering whether the core hypothesis of the Big Data movement is that every sufficiently large pile of horseshit must have a pony in it somewhere. As O'Reilly's Nat Torkington says, "Anyone who thinks it’s possible to draw truthful conclusions from data analysis without really learning statistics needs to read this."
* If good looks and smarts are distributed normally, and
If good looks and smarts have nothing to do with each other, and
If movie producers want both smarts and looks
Then, by observing employed actors we’ll assume that looks and smarts have a negative correlation
Even though we constructed this experiment with no correlation
Here’s a graph of 250 randomly generated points (with no correlation). With the red circles representing “actors who are smart and good looking enough to get a job (looks+smarts>2), and lighter blue x’s representing “people who wanted to be actors”
Clearly if we only look at actors with jobs, we’ll see a clearly negative correlation between smarts and good looks. In fact, some brilliant actors are less attractive than an average person, and some gorgeous actors are dumber than an average person. Even more interesting though, is that if we try to rule out bias by looking at aspiring but unsuccessful actors as well, we’ll find that they exhibit a similar correlation...
You’re probably polluting your statistics more than you think
(via O'Reilly Radar)
I enjoyed learning about statistics, probability, zero, infinity, number sequences, and more in this heavily illustrated kids’ book called How to Be a Math Genius, by Mike Goldsmith. But would my then-11-year daughter like it as much? I handed it to her after school and she become absorbed in it until called for dinner. She […]
The astonishingly prolific author/scientist Clifford Pickover is a math enthusiast with a talent for ferreting out fascinating anecdotes about math, and writing them in a way that inspires wonder. Accompanied by beautiful illustrations, Pickover’s The Math Book about cicada-generated prime numbers, magic squares, the Golden Mean, Penrose Tiles, Xeno’s Paradox, and the butterfly effect just […]
YouTuber 3Blue1Brown has started a video series called “lockdown math.” In his latest episode he goes over the fundamentals of trigonometry in a way that is accessible and enjoyable.
Even though life is emerging following our COVID-19 lockdown, it’s not exactly time to celebrate defeating the insidious virus just yet. CDC officials warn that once a resurgence of the virus hits this winter, it could prove even more disastrous for the U.S. healthcare system than the opening salvo. That would follow the pattern suffered […]
When you were 10 and your mom demanded you finish your vegetables or go to your room, you were mad. Even as kids, we hated it when we were ordered to do something. Car insurance is a federal mandate, yet that’s only one of the reasons why most Americans would rather do just about anything […]
We all know the drill. As the overlords of the smartphone and tablet markets, the braintrust at Apple very seldom hold sales on their signature devices. So rather than spending almost $1,000 on a brand-new iPad Pro, the folks in Cupertino are instead giving you the opportunity to score one for about a third of […]