Professors Max Bazerman and Leif Nelson discuss academic fraud and misconduct, highlighting the prevalence of misconduct in research. They explore the pressures researchers face in publishing, unconventional practices, and the challenges of peer review. They also emphasize the need for transparency in research and a new approach to the incentive system in academia.
Read more
AI Summary
Highlights
AI Chapters
Episode notes
auto_awesome
Podcast summary created with Snipd AI
Quick takeaways
Academic research industry plagued with fraud due to lack of transparency and low accountability.
Pressure to publish and competition for limited spots contribute to fraudulent practices in academia.
Reform needed to promote transparency, accountability, and integrity in academic research.
Deep dives
Academic fraud is prevalent and often goes unpunished
Academic research industry is plagued with misconduct, including fraud, at various levels, from individual researchers to academic journals. The scale of fraud is difficult to quantify precisely, but it is estimated that around 2% of papers should be retracted due to fraud or severe error, while the actual retraction rate is only about 0.1%. The slow investigation process, lack of transparency in retraction notices, and universities' tendency to protect fraudsters contribute to the low accountability in the industry.
Systemic issues in academic research contribute to misconduct
The immense pressure to publish in order to further one's career leads to a competitive environment where integrity may be compromised. Junior researchers face the pressure to publish to secure tenure, while senior researchers may succumb to the temptation of maintaining high status and success. The sheer volume of research being published also contributes to the problem, as journals are flooded with submissions, and the competition for limited spots leads to bold claims and even fraudulent practices.
The need for reform and better gatekeeping
To address academic fraud, there is a need for reform in the research industry. Whistleblowers play a vital role in exposing misconduct, but they are often faced with legal challenges and retaliation. Gatekeepers, such as journal editors and referees, need to take a more proactive approach in preventing fraud by implementing stricter standards, promoting transparency, and incentivizing post-publication critique and correction. Creating a culture of integrity and accountability in academia is crucial to reduce academic fraud.
Increasing Transparency in Academic Research
The Center for Open Science led by Brian Nausick has been working to promote transparency in academic research. The prevailing academic reward system contributes to researchers hoarding their data rather than sharing it. To change this culture, Nausick emphasizes the need to make transparency easier, normative, and incentivized. The Open Science Framework, a software platform developed by Nausick's team, allows researchers to pre-register their projects and hypotheses, providing a more comprehensive and time-stamped record of their work. The registered report model, implemented by over 300 journals, focuses on evaluating the importance of research questions and the effectiveness of methodologies, rather than solely relying on results. These efforts aim to improve the quality and credibility of social science research.
Addressing Incentives and Challenges in Research Reform
The academic research field faces a believability crisis due to flawed incentives and a lack of transparency. Max Baserman highlights the need for massive reform in social science to ensure credibility and reputation. The incentives for publishing uninteresting or redundant findings need to change, and journal editors and reviewers must actively adopt the principles of open science. The meta-science community plays a crucial role in evaluating the effectiveness of research reform initiatives. However, Samin Vazir and other experts note that while significant progress has been made, there is still a long way to go in terms of implementing comprehensive reforms and overcoming resistance from existing publishing incentives. The ongoing dialogue between activism, reform, and evaluation is vital for maintaining a healthy and self-skeptical discipline.
Probably not — the incentives are too strong. Scholarly publishing is a $28 billion global industry, with misconduct at every level. But a few reformers are gaining ground. (Part 2 of 2)
SOURCES:
Max Bazerman, professor of business administration at Harvard Business School.
Leif Nelson, professor of business administration at the University of California, Berkeley Haas School of Business.
Brian Nosek, professor of psychology at the University of Virginia and executive director at the Center for Open Science.
Ivan Oransky, distinguished journalist-in-residence at New York University, editor-in-chief of The Transmitter, and co-founder of Retraction Watch.
Joseph Simmons, professor of applied statistics and operations, information, and decisions at the Wharton School at the University of Pennsylvania.
Uri Simonsohn, professor of behavioral science at Esade Business School.
Simine Vazire, professor of psychology at the University of Melbourne and editor-in-chief of Psychological Science.