Crate warc

Source
Expand description

A WARC (Web ARChive) library

Modules§

parser
Core functions for parsing. Not recommended for direct use.

Structs§

BufferedBody
An associated type indicating the body is buffered within the record.
EmptyBody
An associated type indicated the record has a zero-length body.
RawRecordHeader
A header block of a single WARC record as parsed from a data stream.
RawRecordIter
An iterator of raw records streamed from a reader. See RawRecord for more information.
Record
A single WARC record.
RecordBuilder
A builder for WARC records from data.
RecordIter
An iterator which returns the records read by a reader.
StreamingBody
An associated type indicating the body is streamed from a reader.
StreamingIter
An iterator-like type to “stream” records from a reader.
WarcReader
A reader which iteratively parses WARC records from a stream.
WarcWriter
A writer which writes records to an output stream.

Enums§

Error
An error type returned by WARC header parsing.
RecordType
TruncatedType
WarcHeader
Represents a WARC header defined by the standard.