Data Skeptic cover image

Data Skeptic

Do Results Generalize for Privacy and Security Surveys

Jan 17, 2023
40:21
Snipd AI
Jenny Tang, a Ph.D. student at Carnegie Mellon University discusses the generalization of privacy and security surveys on platforms like Amazon MTurk and Prolific. The podcast explores the challenges of obtaining accurate survey responses and compares different samples from these platforms to the US population. Key insights include differences in gender balance and behavior, with recommendations for future surveys.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • The study found that online survey platforms like MTurk and Prolific are not as representative of the general population as the Pew sample, highlighting the importance of understanding limitations and demographic biases.
  • Text box attention checks are effective in filtering out non-human responses in online surveys, but researchers should be mindful of their impact on survey length and availability of future tasks for workers.

Deep dives

Comparison of Survey Sources

The podcast episode discusses a research study comparing responses from Mechanical Turk (MTurk) and Prolific, two online survey platforms, to a survey conducted by the Pew Research Center. The study aimed to determine if the responses from MTurk and Prolific were representative of the general population. The findings revealed that both MTurk and Prolific samples were not as representative as the Pew sample. However, the representative sample from Prolific performed better than the others. Attention checks were used to filter out non-human responses, and text box attention checks proved to be more effective than other types. Overall, the study highlights the importance of understanding the limitations and demographic biases associated with online survey platforms.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode