Data Type | File List | #Files | Total Size Compressed |
---|---|---|---|
Segments | segment.paths.gz | 6 | |
WARC | warc.paths.gz | 58977 | 6.42 TB |
WAT | wat.paths.gz | 58977 | 108.34 GB |
WET | wet.paths.gz | 58977 | 18.21 MB |
META | meta.paths.gz | 58977 | 36.27 GB |
CDX | cdx.paths.gz | 58977 | 5.82 GB |
URL index files | eot-index.paths.gz | 49 | 4.5 GB |