Highlights: #147 – Spencer Greenberg on stopping valueless papers from getting into top journals
Dec 7, 2023
auto_awesome
Spencer Greenberg, an expert on stopping valueless papers from getting into top journals, discusses the need for better research practices in social science, such as data sharing and replication projects. He also explores the concept of importance hacking in science practice and introduces the FIRE framework for making decisions. Other topics include strategies for changing habits, factors contributing to success, and the challenges of studying success.
Incentives and framing play a crucial role in promoting behavior change, as evidenced by a study on gym attendance.
Conscientiousness, IQ, and the quality of training are consistent predictors of success across various fields.
Deep dives
Behavior change interventions to increase gym attendance
A recent study conducted on tens of thousands of gym members tested multiple behavior change interventions. One promising intervention involved giving people bonuses when they recovered from missing a gym session. Another interesting intervention allowed participants to choose between a gain frame and a loss frame for the points they earned at the gym. The study found that these interventions resulted in increased gym attendance, highlighting the importance of incentives and framing in promoting behavior change.
Factors predicting success in various fields
When it comes to predicting success, certain factors consistently emerge across different fields. Conscientiousness tends to be a valuable trait for a wide range of jobs, although there may be diminishing returns at extremely high levels. IQ is another predictor of job performance, with higher intelligence often leading to better outcomes. Additionally, the quality of training has a significant impact. It's not just about the number of hours spent practicing, but also the presence of high-quality feedback that helps individuals improve their skills.
Improvements in social science research practices
While challenges persist, there are several positive developments in improving social science research practices. More researchers are sharing their data and materials, promoting transparency and reproducibility. The replication of studies is becoming more common, and concepts like registered reports ensure publication regardless of results, reducing the incentive for p-hacking. Increased awareness and skepticism promote critical examination of research methods, fostering a culture of improvement and better scientific practices.
These aren't necessarily the most important, or even most entertaining parts of the interview — and if you enjoy this, we strongly recommend checking out the full episode: