Struct FileStorage 

pub struct FileStorage { /* private fields */ }

High-throughput file-backed storage.

Design:

• One append-only log file per stream (data.log)
• In-memory offset/file index for fast reads
• Stream-level write lock serializes appends and preserves monotonic offsets
• Batched write per append call reduces syscall overhead

Implementations

impl FileStorage

pub fn new( root_dir: impl Into<PathBuf>, max_total_bytes: u64, max_stream_bytes: u64, sync_on_append: bool, ) -> Result<Self>

Errors

Returns Error::Storage if the root directory cannot be created or existing streams fail to load from disk.

pub fn total_bytes(&self) -> u64

Panics

Panics if the internal total_bytes lock is poisoned.

Trait Implementations

impl Storage for FileStorage

fn create_stream( &self, name: &str, config: StreamConfig, ) -> Result<CreateStreamResult>

Create a new stream

fn append(&self, name: &str, data: Bytes, content_type: &str) -> Result<Offset>

Append data to a stream

fn batch_append( &self, name: &str, messages: Vec<Bytes>, content_type: &str, seq: Option<&str>, ) -> Result<Offset>

Append multiple messages atomically

fn read(&self, name: &str, from_offset: &Offset) -> Result<ReadResult>

Read messages from a stream starting at offset

fn delete(&self, name: &str) -> Result<()>

Delete a stream

fn head(&self, name: &str) -> Result<StreamMetadata>

Get stream metadata

fn close_stream(&self, name: &str) -> Result<()>

Close a stream

fn append_with_producer( &self, name: &str, messages: Vec<Bytes>, content_type: &str, producer: &ProducerHeaders, should_close: bool, seq: Option<&str>, ) -> Result<ProducerAppendResult>

Append messages with producer sequencing (atomic validation + append)

fn create_stream_with_data( &self, name: &str, config: StreamConfig, messages: Vec<Bytes>, should_close: bool, ) -> Result<CreateWithDataResult>

Atomically create a stream with optional initial data and close.

fn exists(&self, name: &str) -> bool

Check if a stream exists

fn subscribe(&self, name: &str) -> Option<Receiver<()>>

Subscribe to notifications for new data on a stream.