Everything Hertz

We chat with Amy Orben, who applies "multiverse" methodology to combat and expose analytical flexibility in her research area of the impact of digital technologies on psychological wellbeing. We also discuss ReproducibiliTea, an early career researcher-led journal club initiative she co-founded, which helps young researchers create local open science groups. Here are some more details and links: The tweet pointing our Dan's gramatical error in his usual introduction. THANKS DENIS Is Twitter melting our brains? The history of "new technology" panic What's the next panic? Moral entrepreneurs: profiting from moral panic Specification curve analysis: a way to run all theoretically defensible analysis options on a given dataset Amy's Nature Human Behavior paper Amy's PNAS paper The longitudincal effect of social media use on life satisfaction How should scientists speak out against dodgy science? The story behind Reproducabilitea The ReproducibiliTea podcast ReproducibiliTea stickers! The UK Reproducibility network Daniel Lakens' Coursera course A multiverse of multiverses Press releasing every paper might not be the best idea Amy's book recommendation: The long way to a small angry planet Other links Amy on Twitter [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the one dollar tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, May 21) "A GPS in the Garden of Forking Paths (with Amy Orben)", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/38KPESpecial Guest: Amy Orben.Support Everything Hertz

By popular demand, Dan and James are kicking it old school and just shooting the breeze. They cover whether scientists should be on Twitter, if Fortnite is ruining our youth, book recommendations, and null oxytocin studies. Stuff they cover and links to obsure references Should scientists be on twitter? James runs a Twitter experiment Scite has now gone live, listen to our episode on this platform Our dreams of a live Hertz episode Is Fortnite killing our youth and the parallels with the “heavy metal” scare Amy Orben’s screen time study Multiverse analysis Book recommendations: Kevin Mitchell’s "Innate", Gareth Leng's "Heart of the brain" Daryl dug a hole reference, from the Aussie classic, "The Castle" A new null oxytocin paper and the twitter response, and Dan's response The SANS meeting venue QR codes on posters The slides to Dan’s oxytocin talk at SANS The Hertz Hype Cycle Dan recollects one of the first conversations he had with James Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the one dollar tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, May 8) "Back to our dirty unwashed roots", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/N9BGXSupport Everything Hertz

We answer a listener question on the possible negative consequences of the open science movement—are things moving too quickly? Links and things we discuss in the episode: We have a new logo, if you haven't already noticed... Contact us via our website form! Considering the potential downsides of open science Here come dat boi meme explination The dangers of open access by fiat The role of commercial entities in open science The “University of Oslo fancy Norway people-pay-taxes oil money bloody library” Dropping the success rate of grants to increase the quality of evaluation Reframing open science reform efforts to a mission of equity and fairness We don’t know the process behind university sexual harassment/misconduct investigations Does transparency even matter if people won’t follow up on problems? James' prediction: If someone starts a journal that ONLY does Registered Report, this will be very successful The milkshake duck tweet and an explanation Paul Roos and his “no dickheads” policy Linking DOIs We can't let edge case scenarios, which may not even play out, hobble progress Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the one dollar tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, April 15) "More janitors and fewer architects" Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/7ZR9JSupport Everything Hertz

We answer our first audio question, on whether academia is too broken to fix, and a second question on whether we’ve ever worried about the possible repercussions of our public critiques and commentary on academia. Show details: Our first audio question is from Erin Williams (@DrErinWill), who asks whether academia is too broken to fix The letter to the editor that got rejected, despite the publication of the response to the letter Harassment in academia Have we ever been worried that someone might say, "I'd never hire those dudes" because of what we say? Other stuff that has happened to us as a result of the podcast Fahrenheit vs. Celsius Supply and demand for academic jobs The criticism that comes with putting yourself out there Links @ReproRocks: for those working in reproduction to share their work through twitter The Steven Pinker book - The Better Angels of Our Nature: Why Violence Has Declined Twitter thread from @drderringer Me too Stem blog Gideon on Twitter: @GidMK Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the one dollar tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, April 1) "Too Young To Know, Too Old To Care" Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/W6MERSupport Everything Hertz

We chat with Sean Rife, who the co-founder of scite.ai, a start-up that combines natural language processing with a network of experts to evaluate the veracity of scientific work. Here's what we cover and links for a few things we mention What is scite.ai? The Winnower Why is there no good (and free) plagiarism detector? Grobid - A machine learning library for extracting, parsing and re-structuring PDFs Meta-analysis can prop up flawed bodies of literature The "Too meta" XKCD cartoon What’s the end game for scite? The 80,000 hours game Spooner, a utility that allows authors of scientific publications to make their work available to the general public (probably) without violating publishing agreements Other links [Sean on twitter](www.twitter.com/seanrife) [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the $1 tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, March 18) "Cites are not endorsements", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/Q9EYGSpecial Guest: Sean Rife.Support Everything Hertz

We chat with Henry Drysdale (University of Oxford), co-founder of the COMPare trials project, which compared clinical trial registrations with reported outcomes in five top medical journals and qualitatively analysed the responses to critical correspondence. Discussion points and links galore: The history behind the COMPare project The two papers that were published: a prospective cohort study correcting and monitoring 58 misreported trials and a qualitative analysis of researchers’ responses to critical correspondence Ben Goldacre's books What is outcome switching? What were some of the responses to query letters from the authors and journals? Misreporting trials (usually) doesn't lead to patient harm, but it harms the evidence base Where should the buck stop with outcome switching? Would Registered Reports solve this problem? The CONSORT guidelines Have the journals changed their practices? COMPare on twitter The COMPare website Here is Henry on Twitter - @HenryMDrysdale Here is Ben Goldacre on Twitter - @bengoldacre Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the $1 tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, March 4) "Clinical trial reporting (with Henry Drysdale)", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/HBX8RSpecial Guest: Henry Drysdale.Support Everything Hertz

In this episde, we chat with Lisa DeBruine (University of Glasgow) about her experience with large-scale collaborative science and how her psychology department made the switch from SPSS to R. Discussion points and links galore: Deborah Apthorp's tweet on having to teach SPSS, "because that's what students know" People who are involved with teaching R for psychology at the University of Glasgow: @Eavanmac @dalejbarr @McAleerP @clelandwoods @PatersonHelena @emilynordmann Why the #psyTeachR started teaching R for reproducible science Data wrangling vs. statistical analysis The psyTeachR website Danielle Navarro, and her R text book that you should read Lisa's "faux" package for data simulation Sometimes you can't share data, simulations are a good way around this problem "synthpop" is the name of the package that Dan mentioned that can simulate census data Power analysis can be hard once you go beyond the more conventional statistical tests (e.g., t-tests, ANOVAs etc...) Lisa's OSF page Dirty code is always better than no code (but the cleaner the better) Live coding is terrifying but a useful teaching tool. Here's Dan live coding how to build a website in R, typos and all Using a Slack group for help The psychological science accelerator Chris Chartier (Psych Science Accelerator Director) on Twitter A few of the other (hundreds) of folks involved with the Psych Science Accelerator Director: @PsySciAcc: @CRChartier @Ben_C_J @JkayFlake @hmoshontz Lisa's Registered Report project on face rating The challenges associated with collaborating with 100+ labs Authorship order Author contributions: CRediT taxonomy The DARPA-funding project on using AI to determine reproducibility Interacting Minds workshop in Denmark in March on open science and reproducibility Lisa shares what Glasgow is like Lisa has changed her mind about the importance of research metrics (h-index, impact factors etc...) Lisa thinks you should read this paper on equivalence testing, which includes two former guests, Daniel Lakens, Anne Scheel, and friend of the show Peder Isager. Here's the latest episode from Psych Soc O'Clock Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the first tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, February 18) "Large-scale collaborative science (with Lisa DeBruine)", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/JDT6FSpecial Guest: Lisa DeBruine.Support Everything Hertz

Dan and James discuss how to deal with the problem of scientists who start talking about topics outside their area of expertise. They also discuss what they would do differently if they would do their PhDs again Here's what they cover... The podcast will now be permanently archived on Open Science Framework James did a talk at the Sound Education conference on podcasting for early career researchers. Here's the video if you want to see him squirm uncomfortably in his chair for 20 minutes and/or hear his thoughts our approach to podcasting The temptation for academics to believe their own press and to have their thoughts reinforced by the praise they get Keeping a handle on what you know and don't know Nassim Nicholas Taleb has FANS The "Pete Evans" effect, James' solution, that we should eat Pete Evans, pesca-pescaterianism, and the spectacularly bad advice that we should stare into the sun You should follow gynecologist Jennifer Gunter on Twitter How much money would you pay for 100,000 engaged twitter followers? Here's the tweet James was referring to Should researchers have something like a Hippocratic Oath? How would we police this? Researchers are not good at admitting they're wrong, do we need to approach retractions differently? Would a bounty system, in which journals offer rewards, for finding errors in their papers, work well? The "Loss of confidence" project, and Rebecca Willen's CV The "Nobel disease" Other links [Dan on twitter](www.twitter.com/dsquintana) [James on twitter](www.twitter.com/jamesheathers) [Everything Hertz on twitter](www.twitter.com/hertzpodcast) [Everything Hertz on Facebook](www.facebook.com/everythinghertzpodcast/) Music credits: [Lee Rosevere](freemusicarchive.org/music/Lee_Rosevere/) Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the $1 tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Episode citation and permanent link Quintana, D.S., Heathers, J.A.J. (Hosts). (2019, February 4) "Promiscuous expertise", Everything Hertz [Audio podcast], doi: 10.17605/OSF.IO/VYCAHSupport Everything Hertz

Peer review is typically conducted behind closed doors. There's been a recent push to make open peer review standard, but what's often left out of these conversations are the potential downsides. To illustrate this, Dan and James discuss a recent instance of open peer review that led to considerable online debate. Here's what they cover... How should we navigate the open review of preprints? Gate keepers gonna gate keep, but is this better out in the open? Weaponising openness Some people don't realise that some data can’t be shared Should the reviewers of rejected papers follow them to the next journal? When bad papers that you reject pop up in another journal, unchanged Does the venue and timing of the open peer review matter? Signing your reviews Using publons to track your reviews Links Brad Love’s blog post: http://bradlove.org/blog/open-review Niko’s blog post: https://nikokriegeskorte.org/2019/01/09/whats-the-best-measure-of-representational-dissimilarity/ Publons: https://publons.com Dan on twitter: https://www.twitter.com/dsquintana James on twitter: https://www.twitter.com/jamesheathers Everything Hertz on twitter: https://www.twitter.com/hertzpodcast Everything Hertz on Facebook: https://www.facebook.com/everythinghertzpodcast/ Music credits: Lee Rosevere freemusicarchive.org/music/Lee_Rosevere/ Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the $1 tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Support Everything Hertz

We’re joined by Daniele Marinazzo (University of Ghent) to chat about the recently launched overlay journal Neurons, Behavior, Data analysis and Theory (NBDT), for which he on the Editorial Board. An overlay journal is organised a set of manuscripts that is published and hosted by a seperate entity (in this case, the Arxiv server), a feature that dramatically reduces publication costs. We discuss the unique overlay model, how this can drive article fees to essentially zero, and what it takes to build a good community journal. Here’s what we cover: Why launch a new neuroscience journal and how is it different from currently established journals? The unique way that editor’s decide which papers to send out for review How does the journal operate when it’s open access and submissions only cost $10? How do you build a journal that your target community will recognise as a ‘good’ journal? The process of submitting a manuscript to NBDT Should journals allow or encourage authors to suggest potential reviewers for their papers? Using Twitter to find reviewers based on who’s ‘liked’ the preprint Is posting a preprint on twitter actually useful? What can neuroscience learn from the field of physics? Authorship attribution How can a journal better champion early career researchers? Links... NBDT journal: https://nbdt.scholasticahq.com Danielle on twitter: https://twitter.com/dan_marinazzo Dan on twitter https://www.twitter.com/dsquintana James on twitter https://www.twitter.com/jamesheathers Everything Hertz on twitter https://www.twitter.com/hertzpodcast Everything Hertz on Facebook https://www.facebook.com/everythinghertzpodcast/ Music credits: Lee Rosevere freemusicarchive.org/music/Lee_Rosevere/ Support us on Patreon and get bonus stuff! $1 a month or more: Monthly newsletter + Access to behind-the-scenes photos & video via the Patreon app + the the warm feeling you're supporting the show $5 a month or more: All the stuff you get in the $1 tier PLUS a bonus mini episode every month (extras + the bits we couldn't include in our regular episodes) Special Guest: Daniele Marinazzo.Support Everything Hertz