BJKS Podcast 55. Angelika Stefan: p-hacking, simulations, and Shiny Apps
Angelika Stefan is a PhD student at the University of Amsterdam in the Psychological Methods group (lead by Eric-Jan Wagenmakers). In this conversation, we talk about her preprint 'Big little lies: A Compendium and Simulation of p-Hacking Strategies', which she just uploaded to PsyArXiv. We also discuss how she created the Shiny App that allows users to play around with the simulations and run simulations that didn't make it into the paper.
BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith. In 2022, episodes will appear irregularly, roughly twice per month. You can find the podcast on all podcasting platforms (e.g., Spotify, Apple/Google Podcasts, etc.).
Timestamps
00:05: How did Angelika start working on her paper 'Big little lies'
05:22: P-hacking and human error
07:47: Different p-hacking strategies
29:34: What are good solutions against p-hacking?
40:56: Future directions for this kind of research
45:32: How to make a Shiny Apps
Podcast links
- Website: https://geni.us/bjks-pod
- Twitter: https://geni.us/bjks-pod-twt
Angelika's links
- Google Scholar: https://geni.us/stefan-scholar
- Twitter: https://geni.us/stefan-twt
Ben's links
- Website: https://geni.us/bjks-web
- Google Scholar: https://geni.us/bjks-scholar
- Twitter: https://geni.us/bjks-twt
References and links
- Stefan, A., & Schönbrodt, F. D. (2022, March 16). Big Little Lies: A Compendium and Simulation of p-Hacking Strategies. https://doi.org/10.31234/osf.io/xy2dk
- Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A checklist to avoid p-hacking. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01832
- Their Shiny App: https://shiny.psy.lmu.de/felix/ShinyPHack/
- Shiny tutorial videos: https://shiny.rstudio.com/tutorial/
- As Predicted preregistration template: https://aspredicted.org/