Questions about a widely cited paper are the latest to be raised about methods used in behavioral research.

Archive Link from archive.today

Original link from The New York Times

@0x815@feddit.de
link
fedilink
English
21Y

Nah, that was empirical research 🤭

Rekorse
link
fedilink
61Y

It’s a fascinating article title right? The story is pretty wild when you read the details of it too. most of the evidence of what happened is public and linked in the story so I encourage y’all to read them.

In short, I don’t think this is isolated to this one researcher. In fact on one of her papers there are TWO INDEPENDANT CASES of statistical fraud by two different people.

Another interesting thing to note is that overall when it comes to the ability to reproduce a study, many of these peer reviewed studies do not hold up to scrutiny. One of the articles covering this story mentioned that less than 50% of the studies were able to be reproduced.

Here’s another article that puts the number higher than two-thirds:
https://www.npr.org/sections/health-shots/2018/08/27/642218377/in-psychology-and-other-social-sciences-many-studies-fail-the-reproducibility-te

Jo
link
fedilink
7
edit-2
1Y

The high rate of failure to replicate is not, in and of itself, evidence of fraud. It’s primarily a problem with low power to detect plausible effects (ie small sample sizes). That’s not to say there isn’t much deliberate fraud or p-hacking going on, there’s far too much. But the so-called replication crisis was entirely predictable without needing to assume any wrongdoing. It happened primarily because most researchers don’t fully understand the statistics they are using.

There was a good paper published on this recently: Understanding the Replication Crisis as a Base Rate Fallacy

And this is a nice simple explanation of the base rate fallacy for anyone who can’t access the paper: The p value and the base rate fallacy

tl;dr p<0.05 does not mean what most researchers think it means

Chetzemoka
link
fedilink
41Y

The Harvard scholar is being accused of deliberately fabricating study results by changing data in a spreadsheet on at least one of the studies.

I think the other commenter mentioned lack of replicability because that’s often one of the first indications that the original research results were fraudulent. Inability to reproduce will cause people to go digging through the original data, which is how this stuff gets found in many cases.

semi [he/him]
link
fedilink
English
11Y

The blog posts mentioned in the NYT article [1, 2, 3] are also worth a read, if you want to understand the evidence for tampering.

Reads like an Onion headline

Ironic

@fleabomber@lemm.ee
link
fedilink
English
71Y

Donchu think?

@thejml@lemm.ee
link
fedilink
English
71Y

A little TOO ironic.

M. Orange
link
fedilink
English
41Y

And yeah I really do think…

@wet_lettuce@beehaw.org
link
fedilink
English
41Y

It’s like raaaaaa eeeeeee aaaaaain

niktemadur
link
fedilink
111Y

Now there’s a The Onion headline if I’ve ever seen one.

I thought it was one at first

SpermKiller
link
fedilink
31Y

I thought r/nottheonion had made the jump to the fediverse

It does exist

Create a post

Breaking news from around the world.

News that is American but has an international facet may also be posted here.


Guidelines for submissions:
  • Where possible, post the original source of information.
    • If there is a paywall, you can use alternative sources or provide an archive.today, 12ft.io, etc. link in the body.
  • Do not editorialize titles. Preserve the original title when possible; edits for clarity are fine.
  • Do not post ragebait or shock stories. These will be removed.
  • Do not post tabloid or blogspam stories. These will be removed.
  • Social media should be a source of last resort.

These guidelines will be enforced on a know-it-when-I-see-it basis.


For US News, see the US News community.


This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

  • 1 user online
  • 26 users / day
  • 64 users / week
  • 168 users / month
  • 663 users / 6 months
  • 1 subscriber
  • 2.74K Posts
  • 15K Comments
  • Modlog