Struct ScannerConfig 

pub struct ScannerConfig {
    pub include_hidden: bool,
    pub respect_gitignore: bool,
    pub read_contents: bool,
    pub max_file_size: u64,
    pub skip_symbols: bool,
    pub use_mmap: bool,
    pub accurate_tokens: bool,
    pub use_pipelining: bool,
    pub batch_size: usize,
}

Runtime configuration for repository scanning

This is the operational config used during scanning, as opposed to crate::config::ScanConfig which is for configuration file settings.

Example

use infiniloom_engine::scanner::ScannerConfig;

// Fast CLI-style scanning with estimation
let cli_config = ScannerConfig::default();

// Accurate API-style scanning with tiktoken
let api_config = ScannerConfig {
    accurate_tokens: true,
    ..Default::default()
};

Fields

include_hidden: bool

Include hidden files (starting with .)

respect_gitignore: bool

Respect .gitignore files

read_contents: bool

Read and store file contents

max_file_size: u64

Maximum file size to read (bytes)

skip_symbols: bool

Skip symbol extraction for faster scanning

use_mmap: bool

Use memory-mapped I/O for files >= MMAP_THRESHOLD (1MB) Default: true

accurate_tokens: bool

Use accurate tiktoken tokenization instead of estimation Default: false (estimation is ~80x faster)

use_pipelining: bool

Use pipelined architecture for repos >= PIPELINE_THRESHOLD files Default: true

batch_size: usize

Maximum files to process in a single parallel batch Prevents stack overflow on repos with 75K+ files Default: 5000

Implementations

impl ScannerConfig

pub fn fast() -> Self

Create config for fast CLI-style scanning

pub fn accurate() -> Self

Create config for accurate API-style scanning

Trait Implementations

impl Clone for ScannerConfig

fn clone(&self) -> ScannerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ScannerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ScannerConfig

fn default() -> Self

Returns the “default value” for a type.