Data Type | File List | #Files | Total Size Compressed |
---|---|---|---|
Segments | segment.paths.gz | 26 | |
WARC | warc.paths.gz | 239811 | 266.04 TB |
WAT | wat.paths.gz | 239811 | 9.15 TB |
WET | wet.paths.gz | 239811 | 2.6 TB |
META | meta.paths.gz | 239811 | 712.66 GB |
CDX | cdx.paths.gz | 239811 | 83.66 GB |
URL index files | eot-index.paths.gz | 49 | 74.4 GB |