100. Tom Chivers: Thomas Bayes, Bayesian statistics, and science journalism
Aug 16, 2024
auto_awesome
Tom Chivers is a prominent science journalist and author, well-known for his expertise in applied statistics and Bayesian methods. He discusses his new book that explores the legacy of Thomas Bayes and the intricacies of Bayesian statistics. Chivers delves into how these concepts can help address the replication crisis in science. He shares insights from his journey into journalism, the philosophical debates around probability, and the evolution of scientific models, while emphasizing the critical thinking necessary for interpreting data.
Tom Chivers emphasizes Bayes' theorem as a vital framework for understanding decision-making and enhancing predictive analysis across various fields.
The podcast illustrates the historical evolution of probability theory, highlighting significant contributions from mathematicians like Pascal, Fermat, and Bayes.
Bayesian statistics is presented as a practical solution to the replication crisis in psychology, enabling better interpretation of results through prior knowledge.
Deep dives
The Relevance of Bayes' Theorem
The discussion highlights the significance of Bayes' theorem in understanding various aspects of life and decision-making. The speaker emphasizes that Bayes provides a different perspective on probability that extends beyond simple historical facts and examples, allowing for a more comprehensive understanding of how our brains function and how we predict future events. By connecting Bayes' insights to numerous fields, including science and super forecasting, the podcast illustrates how this theorem can illuminate our understanding of intelligence and learning patterns. Ultimately, the goal is to present Bayes' theorem as a foundational framework for interpreting complex real-world scenarios.
A Brief History of Thomas Bayes
The podcast explores the life of Thomas Bayes, noting the limited information available about him due to societal context and record-keeping practices of the time. It mentions that Bayes came from a well-to-do family involved in ironworks, and many of his relatives were involved in non-conformist preaching due to restrictions on religious practices. The speaker shares anecdotes highlighting the difficulty in pinpointing Bayes' exact birth date and his contributions to mathematics, including his membership in the Royal Society. This historical context sets the stage for understanding the evolution of Bayes' theorem and its eventual impact on probability theory.
The Evolution of Probability Theory
The podcast delves into how probability theory transitioned from historical observations of games of chance to a more nuanced understanding through the work of mathematicians like Pascal, Fermat, and later, Bayes. Key advancements are discussed, including how Bayes distinguished the difference between predicting outcomes based on observed results versus understanding the likelihood of a hypothesis given evidence. This shift in perspective was crucial in advancing the application of probability in various domains, from science to decision-making. The emphasis is on how past thinkers laid the groundwork for the modern methodologies employed in data analysis and statistical inference.
The Role of Richard Price
Richard Price emerges as a pivotal figure in the dissemination of Bayes' theorem, having published Bayes' work posthumously. His contributions not only brought Bayes' ideas to a broader audience but also delineated how they could be applied in practical contexts. Price's perspective on Bayes' theorem aligns with issues of faith and certainty, providing a defense against skepticism about miracles through probability. This intersection of probability and theology enhances the understanding of how ideas can bridge different realms of thought, revealing the contemporary implications of Bayes' work.
Bayesian vs Frequentist Statistics
The podcast touches on the tension between Bayesian and frequentist statistical methods, illustrating the subjective nature of Bayesian reasoning. The speaker explains how Bayesian statistics allows for the incorporation of prior knowledge which can lead to more nuanced interpretations of results, with implications for various scientific inquiries. Examples include discussions about the replication crisis in psychology, where Bayesian methods could potentially offer solutions to mitigate issues of statistical significance misinterpretation and publication bias. The debate continues as to which framework best serves scientific inquiry, highlighting the evolving nature of statistical thinking.
Implications of Bayesian Thought
The podcast examines how Bayesian thought processes align with real-world applications, particularly in decision-making and risk assessment. The speaker highlights that Bayesian analysis provides tools for integrating new information into existing beliefs to refine predictions and choices. This practical approach enables individuals and organizations to adopt a more dynamic and flexible way of interacting with uncertainty, emphasizing the importance of updating beliefs based on evidence. The broader impact of Bayes' theorem extends into areas like artificial intelligence and economics, showcasing its versatility and relevance in contemporary discourse.
Tom Chivers is a journalist who writes a lot about science and applied statistics. We talk about his new book on Bayesian statistics, the biography of Thomas Bayes, the history of probability theory, how Bayes can help with the replication crisis, how Tom became a journalist, and much more.
BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith.
Timestamps 0:00:00: Tom's book about Bayes & Bayesian statistics relates to many of my previous episodes and much of my own research 0:03:12: A brief biography of Thomas Bayes (about whom very little is known) 0:11:00: The history of probability theory 0:36:23: Bayesian songs 0:43:17: Bayes & the replication crisis 0:57:27: How Tom got into science journalism 1:08:32: A book or paper more people should read 1:10:05: Something Tom wishes he'd learnt sooner 1:14:36: Advice for PhD students/postdocs/people in a transition period
Bayes (1731). Divine benevolence, or an attempt to prove that the principal end of the divine providence and government is the happiness of his creatures. Being an answer to a pamphlet entitled Divine Rectitude or an inquiry concerning the moral perfections of the deity with a refutation of the notions therein advanced concerning beauty and order, the reason of punishment and the necessity of a state of trial antecedent to perfect happiness. Bayes (1763). An essay towards solving a problem in the doctrine of chances. Philosophical transactions of the Royal Society of London. Bellhouse (2004). The Reverend Thomas Bayes, FRS: a biography to celebrate the tercentenary of his birth. Project Euclid. Bem (2011). Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect. Journal of personality and social psychology. Chivers (2024). Everything is Predictable: How Bayesian Statistics Explain Our World. Chivers & Chivers (2021). How to read numbers: A guide to statistics in the news (and knowing when to trust them). Chivers (2019). The Rationalist's Guide to the Galaxy: Superintelligent AI and the Geeks Who Are Trying to Save Humanity's Future. Clarke [not Black, as Tom said] (2020). Piranesi. Goldacre (2009). Bad science. Goldacre (2014). Bad pharma: how drug companies mislead doctors and harm patients. Simmons, Nelson & Simonsohn (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode