End of Term 2016 Dataset (EOT-2016)

Data Size and File Listings

Data Type File List #Files Total Size
Compressed
Segments segment.paths.gz 22
WARC warc.paths.gz 194683 139.3 TB
WAT wat.paths.gz 194683 1.7 TB
WET wet.paths.gz 194683 330.81 GB
META meta.paths.gz 194683 167.95 GB
CDX cdx.paths.gz 194683 25.36 GB
URL index files eot-index.paths.gz 49 23.1 GB