Skip to main content

page

Function page 

Source
pub fn page(path: &Path, offset: usize, limit: usize) -> Result<Value>
Expand description

Records offset..offset + limit of a records artifact: the payloads of complete records whose checksums hold, at most INLINE_CAP bytes of payload (always at least one record). next_offset is where the next page starts; available counts the complete records now in the file, which a running job may extend.

A record is a newline-terminated, non-blank line; a final line without its newline is still being written and does not count. The file is read once as a stream: records before offset are only counted, and only the page’s records are parsed and checked, so a page costs one pass over the bytes and memory for the page alone, however long the artifact is.