Writing in The Guardian, Ben "Bad Science" Goldacre debunks a story published in sister paper The Observer about the supposed benefits of fish oil. Not only were the study and its results badly misreported (it wasn't even a study on fish-oil, but rather on Omega-3 fatty acids), but it constitutes part of a larger pattern of bad reporting that ultimately benefits dietary supplement vendors who make insane, unsubstantiated claims about their products' benefits.
If this had been a trial to detect whether omega-3 improves performance, it would be laughably small: a dozen children in each group. While small studies aren't entirely useless, as amateurs often claim, you do have a very small number of observations to work from, so your study is much more prone to error from the simple play of chance. A study with 11 children in each arm could conceivably detect an effect, but only if the fish oil caused a gigantic and unambiguous improvement in all the children who got it, and none on placebo improved.
This paper showed no difference in performance at all. Since it was a brain imaging study, not a trial, they only report the results of children's actual performance on the attention task in passing, in a single paragraph, but they are clear: "there were no significant group differences in percentage correct, commission errors, discriminability, or reaction time"…
And oddly enough, someone has finally now conducted a proper trial of fish oils pills in mainstream children, to see if they work: a well-conducted, randomised, double-blind, placebo-controlled trial, in 450 children aged 8-10 years old from a mainstream school population. It was published in full this year (http://qurl.com/fish), and they found no improvement. Show me the news headlines about that paper.
(Image: Fish oil caps, a Creative Commons Attribution (2.0) image from spcummings's photostream)
- Bad Science Begets Ridiculous Results
- Bad Science versus the piracy scare story
- Corrupted Science: the history, cause, effect and state of bad …
- What's wrong with evolutionary psychology?
- Bad science fact on a Happy Meal bag
- BBC shredded on bad science in WiFi scare report
- More bad science on kids' food packages
- Which supplements really work? An interactive guide to evidence …
- The danger of science denialism