Software Engineering Radio - the podcast for professional software developers cover image

Episode 503: Diarmuid McDonnell on Web Scraping

Software Engineering Radio - the podcast for professional software developers

00:00

How Much Data Do You Need?

Web scraping can be collected at a scale that's very difficult to do through traditional means like surveys or focus groups, interviews, experiments and so on. T's when i've ben looking at the impact of the pandemic on non profit sectors. For example, i'm collecting, you know, tens of thousands, if not millions, of records for each jurisdiction. And than i'm aggregating all that information into a time series of the number of charities or non profits that are disappearing every month.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app