AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Crawlers for Ads - Is That Right?
We've been running web crawlers to collect data on this. And because these companies aren't very keen to share this type of information with us generally, our approach is to run these web crawlers that will basically open a page and then identify all the ads on the page. Our crawls can get fairly large. So sometimes we'll crawl hundreds of thousands or million ads at once, all over over time. I guess we ran a few different crawls for different studies. We were interested in identifying deceptive political ads during the 20 20 election. And so we ran crawls every day on this list of web sites from september 20 twentieth to january 20 21. And so collected