BS ISO 28500:2017
Information and documentation. WARC file format
| Standard number: | BS ISO 28500:2017 |
| Pages: | 36 |
| Released: | 2017-09-11 |
| ISBN: | 978 0 580 95168 8 |
| Status: | Standard |
BS ISO 28500:2017
This standard BS ISO 28500:2017 Information and documentation. WARC file format is classified in these ICS categories:
- 35.240.30 IT applications in information, documentation and publishing
This document specifies the WARC file format:
to store both the payload content and control information from mainstream Internet application layer protocols, such as the HTTP, DNS, and FTP;
to store arbitrary metadata linked to other stored data (e.g. subject classifier, discovered language, encoding);
to support data compression and maintain data record integrity;
to store all control information from the harvesting protocol (e.g. request headers), not just response information;
to store the results of data transformations linked to other stored data;
to store a duplicate detection event linked to other stored data (to reduce storage in the presence of identical or substantially similar resources);
to be extended without disruption to existing functionality;
to support handling of overly long records by truncation or segmentation, where desired.