AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
#283: Web scraping, the 2020 edition
Talk Python To Me
Scrappy and JavaScript Integration
2min Snip
00:00
Summary
Transcript
Episode notes
If you cannot find an API like this, you need to execute JavaScript using some kind of headless browser like Selenium or a Puppeteer. You can integrate splash with scrappy really easily. It's literally just like a middleware in scrappy. And then it will execute JavaScript for you.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode