End of Term 2008 Dataset (EOT-2008)

Data Size and File Listings

Data Type File List #Files Total Size
Compressed
Segments segment.paths.gz 14
WARC warc.paths.gz 125704 15.32 TB
WAT wat.paths.gz 125704 447.08 GB
WET wet.paths.gz 125704 108.1 GB
META meta.paths.gz 125704 68.49 GB
CDX cdx.paths.gz 125704 9.41 GB
URL index files eot-index.paths.gz 49 7 GB