Struct DataLoader 

pub struct DataLoader { /* private fields */ }

Data loader for discovering and streaming JSONL files

The DataLoader is responsible for finding Claude usage data files on the system and providing efficient streaming access to parse them.

Implementations

impl DataLoader

pub async fn new() -> Result<Self>

Create a new DataLoader by discovering Claude paths

This method automatically searches for Claude data directories in platform-specific locations.

Errors

Returns an error if no Claude data directories are found

pub async fn find_jsonl_files(&self) -> Result<Vec<PathBuf>>

Find all JSONL files in the discovered directories

Recursively searches for .jsonl files in all discovered Claude directories.

Returns

A vector of paths to JSONL files found

pub async fn find_recent_jsonl_files( &self, since: DateTime<Utc>, ) -> Result<Vec<PathBuf>>

Find JSONL files modified since a given date

This is useful for performance optimization when you only need recent data, such as for statusline generation which only needs today’s data.

Arguments

• since - Only include files modified after this time

Returns

A vector of paths to JSONL files modified since the given date

pub fn with_progress(self, show_progress: bool) -> Self

Enable or disable progress bars

pub fn with_interning(self, use_interning: bool) -> Self

Enable string interning for memory optimization

pub fn with_arena(self, use_arena: bool) -> Self

Enable arena allocation for parsing

pub fn load_usage_entries_parallel( &self, ) -> impl Stream<Item = Result<UsageEntry>> + '_

Load usage entries in parallel for better performance

This method uses Rayon to process multiple JSONL files concurrently, providing significant performance improvements for large datasets.

Returns

An async stream of Result<UsageEntry> items processed in parallel

pub fn load_recent_usage_entries( &self, since: DateTime<Utc>, ) -> impl Stream<Item = Result<UsageEntry>> + '_

Load recent usage entries as an async stream

This method provides a stream of usage entries parsed from JSONL files modified since the given date. It’s optimized for scenarios where you only need recent data, such as statusline generation.

Arguments

• since - Only load entries from files modified after this time

Returns

An async stream of Result<UsageEntry> items from recent files

pub fn paths(&self) -> &[PathBuf]

Get the discovered Claude paths

Returns a slice of all discovered Claude data directories. Useful for debugging or displaying where data is being loaded from.