Good Gear Guide
Finding stuff online: 20 years of innovative searc...
WebCrawler was one of the first search engines that actively sought out new and changing Websites by "crawling" from link to link between sites.
Today, most search engines rely on some variation of this principle to keep their indexes up to date.
Finding stuff online: 20 years of innovative search engines