92. Tom Hardwicke: Meta-research, reproducibility, and post-publication critique

Feb 2, 2024

Ask episode

Chapters

Transcript

Episode notes

Tom Hardwicke is a Research Fellow at the University of Melbourne. We talk about meta-science, incuding Tom's work on post-publication critique and registered reports, what his new role as editor at Psychological Science entails, and much more.

BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith.

Support the show: https://geni.us/bjks-patreon

Timestamps
0:00:00: What is meta-science/meta-research?
0:03:15: How Tom got involved in meta-science
0:21:51: Post-publication critique in journals
0:39:30: How Tom's work (registered reports) led to policy changes at journals
0:44:08: Tom is now the STAR (statistics, transparency, and rigor) editor at Psychological Science
0:48:17: How to best share data that can be used by people with different backgrounds
0:54:51: A book or paper more people should read
0:56:36: Something Tom wishes he'd learnt sooner
1:00:13: Jobs in meta-science
1:03:29: Advice for PhD students/postdocs

Podcast links

Website: https://geni.us/bjks-pod
Twitter: https://geni.us/bjks-pod-twt

Tom's links

Website: https://geni.us/hardwicke-web
Google Scholar: https://geni.us/hardwicke-scholar
Twitter: https://geni.us/hardwicke-twt

Ben's links

Website: https://geni.us/bjks-web
Google Scholar: https://geni.us/bjks-scholar
Twitter: https://geni.us/bjks-twt

References & links
Episodes w/ Nosek, Vazire, & Chambers:
https://geni.us/bjks-nosek
https://geni.us/bjks-vazire
https://geni.us/bjks-chambers
Foamhenge: https://en.wikipedia.org/wiki/Foamhenge
METRICS: https://metrics.stanford.edu/
AIMOS: https://www.youtube.com/@aimosinc4164

Chambers & Mellor (2018). Protocol transparency is vital for registered reports. Nature Human Behaviour.
Hardwicke, Jameel, Jones, Walczak & Weinberg (2014). Only human: Scientists, systems, and suspect statistics. Opticon1826.
Hardwicke & Ioannidis (2018). Mapping the universe of registered reports. Nature Human Behaviour.
Hardwicke, Serghiou, Janiaud, Danchev, Crüwell, Goodman & Ioannidis (2020). Calibrating the scientific ecosystem through meta-research. Annual Review of Statistics and Its Application.
Hardwicke, Thibault, Kosie, Tzavella, Bendixen, Handcock, ... & Ioannidis (2022). Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice. Royal Society Open Science.
Hardwicke & Vazire (2023). Transparency Is Now the Default at Psychological Science. Psychological Science.
Kidwell, Lazarević, Baranski, Hardwicke, Piechowski, Falkenberg, ... & Nosek (2016). Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS biology.
Nosek, Hardwicke, Moshontz, Allard, Corker, Dreber, ... & Vazire (2022). Replicability, robustness, and reproducibility in psychological science. Annual review of psychology.
Ritchie (2020). Science fictions: Exposing fraud, bias, negligence and hype in science.