Comments on: Science, confidential http://boingboing.net/2013/01/08/science-confidential.html Brain candy for Happy Mutants Wed, 22 May 2013 05:34:00 +0000 hourly 1 http://wordpress.org/?v=3.4.1 By: PolSci Replication http://boingboing.net/2013/01/08/science-confidential.html#comment-1625057 PolSci Replication Thu, 10 Jan 2013 21:49:00 +0000 http://boingboing.net/?p=204532#comment-1625057 Interestingly many tweets are directly about reproducibility of results, meaning if the 'next' researcher is able to come to the same conclusions when using your data. Ideally all journals would publish replication data, but that's often not the case. We have to trust scientists that the results are 'true' - but we can't check it. I did a little analysis of the tweets mentioned above. Since the hash tag #overlyhonestmethods went viral, I have been checking tweets for reproducibility issues. Many tweets are in some way connected: every time a researcher admits being 'creative' about getting significant results or slightly 'polishing' tables and figures, it will be harder to check or replicate their results. Some tweets, however, directly refer reproducible results. "you can't reproduce my results because you don't know where the samples come from" "our published code might or might not reproduce our results" "I can't reproduce my own results" ... I included all tweets that came up when searching for reproduc* among tweets between Day 1 (January 7, first tweet by dr_leigh) to January 9, 5.17pm (the method and the exact tweets are on my blog on political science replication http://wp.me/p315fp-5h ) Interestingly many tweets are directly about reproducibility of results, meaning if the ‘next’ researcher is able to come to the same conclusions when using your data. Ideally all journals would publish replication data, but that’s often not the case. We have to trust scientists that the results are ‘true’ – but we can’t check it.

I did a little analysis of the tweets mentioned above. Since the hash tag #overlyhonestmethods went viral, I have been checking tweets for reproducibility issues. Many tweets are in some way connected: every time a researcher admits being ‘creative’ about getting significant results or slightly ‘polishing’ tables and figures, it will be harder to check or replicate their results. Some tweets, however, directly refer reproducible results.

“you can’t reproduce my results because you don’t know where the samples come from”

“our published code might or might not reproduce our results”

“I can’t reproduce my own results”
…
I included all tweets that came up when searching for reproduc* among tweets between Day 1 (January 7, first tweet by dr_leigh) to January 9, 5.17pm (the method and the exact tweets are on my blog on political science replication http://wp.me/p315fp-5h )

]]> By: Lyle Hopwood http://boingboing.net/2013/01/08/science-confidential.html#comment-1623370 Lyle Hopwood Wed, 09 Jan 2013 04:15:00 +0000 http://boingboing.net/?p=204532#comment-1623370 Oh, I thought they were going to be serious methodological issues and I was getting all angry at the bastardization of science.  Or hashtagangry as the kids say these days. In fact, they were just people venting and are quite funny. Oh, I thought they were going to be serious methodological issues and I was getting all angry at the bastardization of science.  Or hashtagangry as the kids say these days. In fact, they were just people venting and are quite funny.

]]> By: surreality http://boingboing.net/2013/01/08/science-confidential.html#comment-1623323 surreality Wed, 09 Jan 2013 03:07:00 +0000 http://boingboing.net/?p=204532#comment-1623323 As someone who isn't in the science field, these are still absolutely hilarious and mostly accessible. Humor transcends educational boundaries. As someone who isn’t in the science field, these are still absolutely hilarious and mostly accessible. Humor transcends educational boundaries.

]]> By: Scurra http://boingboing.net/2013/01/08/science-confidential.html#comment-1622675 Scurra Tue, 08 Jan 2013 18:09:00 +0000 http://boingboing.net/?p=204532#comment-1622675 Wow, this is dangerous - I expect most, if not all of these lines to turn up in speeches by ignorant politicians within months, if not days. Wow, this is dangerous – I expect most, if not all of these lines to turn up in speeches by ignorant politicians within months, if not days.

]]> By: Preston Sturges http://boingboing.net/2013/01/08/science-confidential.html#comment-1622577 Preston Sturges Tue, 08 Jan 2013 17:03:00 +0000 http://boingboing.net/?p=204532#comment-1622577 My favorite statement in a paper was "The only variable that correlated with mortality was age." I wish I'd had that framed. My favorite statement in a paper was “The only variable that correlated with mortality was age.”

I wish I’d had that framed.

]]>