this post was submitted on 23 Oct 2024
537 points (79.5% liked)

Science Memes

11189 readers
2248 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] Jake_Farm@sopuli.xyz 8 points 1 month ago (2 children)

Isn't there a replication crisis. I am not sure you can really claim "most" research is legit.

[–] niucllos@lemm.ee 15 points 1 month ago (1 children)

I wouldn't call it a broad crisis, and it isn't universal. More theoretical sciences or social sciences are more prone to it because the experiments are more expensive and you can't really control the environment the way you can with e.g. mice or specific chemicals. But most biology, chemistry, etc that isn't bleeding edge or incredibly niche will be validated dozens to hundreds of times as people build on the work and true retractions are rare

[–] nooneescapesthelaw@mander.xyz 0 points 1 month ago (1 children)

That's just not true, false research gets posted alot in biology and can go for years without getting caught

For example, the whole Alzheimer's research thing. A paper that was published in nature faked data and sent everybody down the wrong path for Alzheimer's cure for 20 years. They claimed to have found that a certain protein causes Alzheimer's, therefore all new research went towards making drugs that strip that protein.

This was a landmark paper that was in a "hard science" field and still fooled alot of people

[–] niucllos@lemm.ee 4 points 1 month ago

Sure, there will be examples of problems in any field that has hundreds of thousands to millions of humans working in it. That doesn't mean there's a broad crisis, and it doesn't mean that most research is faked or fallible. In your 2004 example, all of the data wasn't faked, some images for publication were doctored. There's been potential links between alzheimer's and aBeta amyloids since at least 1991 (1), long before this paper that posited a specific aB variant as a causal target. Additionally, other Alzheimer's causes and treatments are also under investigation, including gut microbiome studies since at leasg 2017 (2). Finally, drugs targeting aB proteins to remove brain plaques work in preclinical trials, indicating that the 2004 paper was at least on the right track even if they cheated to get their paper published. This showcases science working well: bad-faith actors behaved unethically, but the core parts of their work were replicated and found to be effective, so some groups followed that to clinical trials which are still ongoing, and others followed other leads for a more holistic understanding of the disease.

Also, I'd very much argue that human neurological diseases are both bleeding edge and niche, which inherently means that recognizing problems in studies will take more time than something that is cheaper or faster to test and validate, but problems will eventually be recognized as this one was.

  1. Cras P, Kawai M, Lowery D, Gonzalez-DeWhitt P, Greenberg B, Perry G. Senile plaque neurites in Alzheimer disease accumulate amyloid precursor protein. Proc Natl Acad Sci USA. 1991;88:7552–6.
  2. Cattaneo, A. et al. Association of brain amyloidosis with pro-inflammatory gut bacterial taxa and peripheral inflammation markers in cognitively impaired elderly. Neurobiol. Aging 49, 60–68 (2017).
[–] djsoren19@yiffit.net 1 points 1 month ago* (last edited 1 month ago)

There's a replication crisis in a handful of more recent fields that use human subjects and didn't have hard rules and restrictions on how to treat human subjects in the early 20th century. Psychology is the field that has had the biggest issue, with many old studies having what we now see as serious methodology issues. It doesn't inherently mean all of those studies are wrong, just that they need to be revised with updated methodology to confirm if their results are accurate.

There's also about 1500 years of scientific study aside from that which doesn't relate to human subjects at all, and by this point has been replicated numerous times, so I would not doubt the claim that most research is replicable and valid. I would expect about 80-90% of our collective scientific knowledge to be accurate.