#188 - AMA #30: How to Read and Understand Scientific Studies
Dec 20, 2021
In this engaging AMA, the hosts tackle the intricacies of scientific studies. They demystify how studies evolve from idea to execution, explaining various types like observational and experimental. The discussion highlights the importance of recognizing biases and pitfalls in research. Listeners learn about clinical trial phases, risk assessments, and how to distinguish between relative and absolute risk. Personal insights on effective reading strategies for scientific papers make this a must-listen for anyone looking to navigate the complex world of research.
30:07
forum Ask episode
web_stories AI Snips
view_agenda Chapters
auto_awesome Transcript
info_circle Episode notes
volunteer_activism ADVICE
Scientific Study Process
Begin scientific studies with a clear hypothesis, preferably a null hypothesis.
Design a rigorous experiment, including power analysis and IRB approval, before execution.
insights INSIGHT
Types of Studies
Studies are broadly classified into observational, experimental, or reviews/analyses of other studies.
Observational studies range from individual case reports to larger cohort studies, but they do not involve interventions.
question_answer ANECDOTE
Case Report Example
Peter Attia's first published paper was a case report about a melanoma patient with unusual high calcium levels.
This case report helped others reach a similar diagnosis and illustrates the value of individual observations.
Get the Snipd Podcast app to discover more snips from this episode
In this “Ask Me Anything” (AMA) episode, Peter and Bob dive deep into all things related to studying studies to help one sift through all the noise to find the signal. They define the various types of studies, how a study progresses from idea to execution, and how to identify study strengths and limitations. They explain how clinical trials work, as well as the potential for bias and common pitfalls to watch out for. They dig into key factors that contribute to the rigor (or lack thereof) of an experiment, and they discuss how to measure effect size, differentiate relative risk from absolute risk, and what it really means when a study is statistically significant. Finally, Peter lays out his personal process when reading through scientific papers.
If you’re not a subscriber and listening on a podcast player, you’ll only be able to hear a preview of the AMA. If you’re a subscriber, you can now listen to this full episode on your private RSS feed or on our website at the AMA #30 show notes page. If you are not a subscriber, you can learn more about the subscriber benefits here.
We discuss:
The ever changing landscape of scientific literature [2:15];
The process for a study to progress from idea to design to execution [4:15];
The various types of studies and how they differ [7:30];
The different phases of a clinical trial [19:15];
Observational studies and the potential for bias [26:30];
Experimental studies: Randomization, blinding, and other factors that make or break a study [44:00];
Power, p-values, and statistical significance [56:15];
Measuring effect size: Relative risk vs. absolute risk, hazard ratios, and “Number Needed to Treat” [1:07:45];
How to interpret confidence intervals [1:17:30];
Why a study might be stopped before its completion [1:23:45];
Why only a fraction of studies are ever published and how to combat publication bias [1:31:30];
Why certain journals are more respected than others [1:40:30];
Peter’s process when reading a scientific paper [1:43:45]; and
The Peter Attia Drive