Software Engineering Radio - the podcast for professional software developers

Episode 503: Diarmuid McDonnell on Web Scraping

Mar 16, 2022
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 2min
2
Web Scraping vs Screen Scraping
01:51 • 2min
3
The Use Cases for Web Scraping
04:12 • 4min
4
Web Scraping
07:53 • 2min
5
The Challenges of Web Scraping
10:20 • 3min
6
The Challenges of Web Scraping
13:38 • 3min
7
Web Scraping - Data Quality Challenges
16:17 • 2min
8
Web Scraper Reliability
18:07 • 3min
9
Is There an Active Community for Web Scraping?
21:02 • 2min
10
Web Scraping - How Much Has It Been for You?
23:24 • 2min
11
How to Scrape a Non Profit Sector?
25:19 • 2min
12
How to Scrape Non Profits
27:07 • 3min
13
Web Scraping
29:49 • 2min
14
Python Versus Java
31:47 • 2min
15
Web Scraping - Should I Use Ore?
33:22 • 3min
16
Using Machine Learning and Natural Language Processing on Web Scraping
36:47 • 2min
17
How Much Data Do You Need?
38:52 • 2min
18
Web Scraping
41:09 • 4min
19
Web Scraping as a Social Scientist
45:07 • 2min
20
Learning Computatial Methods
46:59 • 2min
21
Learning From Other Academics
48:29 • 3min