Software Engineering Radio - the podcast for professional software developers cover image

Episode 503: Diarmuid McDonnell on Web Scraping

Software Engineering Radio - the podcast for professional software developers

00:00

The Challenges of Web Scraping

Pythorn is a web scraping tool that can be used to access public records. It was developed by social scientist and computer science graduate, Andrew Kucharski. The project has been described as being 'so intense of reliability' That means you have to overcome limits on how many requests are made in a given time period. To get the most out of pythorn your need to work hard at it for some time before giving up.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app