my personal rule of thumb is that if it’s published in Nature, Cell, or another well-regarded journal, the statistical and experimental methodologies are almost certainly solid. Do you think I should adjust that rule going forward?
Honestly, I always poke the stats no matter how good the journal. The best way to read any article is as a skeptic (the onus is on the writer to prove their point), and any small irregularity is something to be queried.
No matter how good the journal, it’s only as good as the reviewers, and reviewers are humans too. Odds are a paper in nature is all above board, but I’m somewhat of a pedant when it comes to checking test conditions.
i do that to, i also try to find most recent research, anything older than 5+years is suspect, because they always come with revised papers in newer studies/research eventually.
In some fields (e.g. mathematics) old papers hold up well. However, in fields like psychology where the landscape shifts a lot that’s probably a good shout!
sometimes, but they have retracted quite a few papers based on misleading papers, or even AI rgenerated. also because it can mislead readers into thinking “oh this is the sole cause and effect” but not potential alternative scenarios.
my personal rule of thumb is that if it’s published in Nature, Cell, or another well-regarded journal, the statistical and experimental methodologies are almost certainly solid. Do you think I should adjust that rule going forward?
Honestly, I always poke the stats no matter how good the journal. The best way to read any article is as a skeptic (the onus is on the writer to prove their point), and any small irregularity is something to be queried.
No matter how good the journal, it’s only as good as the reviewers, and reviewers are humans too. Odds are a paper in nature is all above board, but I’m somewhat of a pedant when it comes to checking test conditions.
i do that to, i also try to find most recent research, anything older than 5+years is suspect, because they always come with revised papers in newer studies/research eventually.
In some fields (e.g. mathematics) old papers hold up well. However, in fields like psychology where the landscape shifts a lot that’s probably a good shout!
sometimes, but they have retracted quite a few papers based on misleading papers, or even AI rgenerated. also because it can mislead readers into thinking “oh this is the sole cause and effect” but not potential alternative scenarios.