COLLECTED BY
Organization:
Internet Archive
The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the
Wayback Machine.
The seed for Wide00014 was:
- Slash pages from every domain on the web:
-- a list of domains using Survey crawl seeds
-- a list of domains using Wide00012 web graph
-- a list of domains using Wide00013 web graph
- Top ranked pages (up to a max of 100) from every linked-to domain using the Wide00012 inter-domain navigational link graph
-- a ranking of all URLs that have more than one incoming inter-domain link (rank was determined by number of incoming links using Wide00012 inter domain links)
-- up to a maximum of 100 most highly ranked URLs per domain
The seed list contains a total of 431,055,452 URLsThe seed list was further filtered to exclude known porn, and link farm, domainsThe modified seed list contains a total of 428M URLs
The Wayback Machine - https://web.archive.org/web/20160821173242/https://coreos.com/fleet/docs/0.11.3/index.html
fleet 0.11.3 Documentation
CoreOS aggregates individual machines into a single pool of resources. Instead of running a service on a specific machine, services are submitted to the cluster and the cluster manager, fleet, decides where they should run. Fleet allows you to gracefully update CoreOS across your cluster, handles machine failures automatically and allows for efficient resource utilization.
