Skip to main content

read_tail

Function read_tail 

Source
pub fn read_tail(path: &Path, max_lines: usize) -> Result<Vec<TranscriptEntry>>
Expand description

Parse at most max_lines raw lines from the end of the transcript. Useful for distill heuristics that only care about recent turns — avoids loading multi-MB transcripts in full.

Implementation: reads the whole file line-by-line but only keeps the last max_lines raw strings before parsing, so memory usage is bounded by max_lines even for huge files.