
#8 How do Web Search Engines Work?
Kopec Explains Software
00:00
Crawling Is Changing All the Time
In the mid 1990s, we were talking in the millions of pages. Now we're talking in the billions. I wouldn't be surprised if we're in the tens of billions or hundreds of billions of pages. Crawling is changing all the time, like the internet is changed all the time. The volume of crawling is certainly changing.
Transcript
Play full episode