Skip to main content

InMemorySequencer

Struct InMemorySequencer 

Source
pub struct InMemorySequencer { /* private fields */ }
Expand description

A single-node, in-memory Sequencer (Meta = ()): assigns dense offsets and keeps the offset→location index in memory.

The log bytes live durably in the BlobStore, but this index does not survive a restart — use it for tests and single-process work, or persist the index yourself for a crash-durable standalone log.

Implementations§

Source§

impl InMemorySequencer

Source

pub fn new() -> Self

Create an empty sequencer.

Source

pub fn live_object_ids(&self) -> HashSet<String>

Object ids referenced by any live index entry (for orphan reaping).

Trait Implementations§

Source§

impl BoundedSequencer for InMemorySequencer

Source§

fn lookup_page( &self, partition: &PartitionKey, offset: i64, max_entries: usize, max_bytes: usize, ) -> Result<Vec<IndexEntry>, ObjectLogError>

Caller reserves max_metadata_bytes before calling. Includes vector entry headers and cloned full object identifiers. Check retained log_start under the same lock as page copying. No unbounded lookup fallback.
Source§

impl Default for InMemorySequencer

Source§

fn default() -> Self

Returns the “default value” for a type. Read more
Source§

impl Sequencer for InMemorySequencer

Source§

type Meta = ()

Sequencer-private per-batch metadata, forwarded uninterpreted by the engine. object-log’s default sequencers use (); a Kafka coordinator uses its producer-identity fields.
Source§

fn supports_multi_object_commit(&self) -> bool

Opt in to atomic commits containing already-durable batches from several data objects, in creation order. Default preserves one-object calls for custom sequencers that rely on that boundary.
Source§

fn commit( &self, batches: &[CommitBatch<'_, Self::Meta>], ) -> Result<Vec<CommitOutcome>, ObjectLogError>

Assign offsets to durably uploaded batches and persist the index. By default these belong to one object; an opted-in implementation may receive several objects in one ordered call. Returns one CommitOutcome per input batch, in order. Read more
Source§

fn lookup( &self, partition: &PartitionKey, fetch_offset: i64, ) -> Result<Vec<IndexEntry>, ObjectLogError>

Resolve fetch_offset to the ordered index entries covering it onward.
Source§

fn high_watermark( &self, partition: &PartitionKey, ) -> Result<i64, ObjectLogError>

The next offset to be assigned (index-only; no object reads).
Source§

fn log_start_offset( &self, partition: &PartitionKey, ) -> Result<i64, ObjectLogError>

The first readable offset (advances on truncate_before).
Source§

fn truncate_before( &self, partition: &PartitionKey, offset: i64, ) -> Result<Vec<String>, ObjectLogError>

Retention MECHANISM (not policy): drop index entries below offset and return object ids that now have no live references from any partition (objects are multiplexed and shared), for the engine to delete.
Source§

fn supports_conditional_commit(&self) -> bool

Whether this sequencer implements native durable head conditions.
Source§

fn commit_conditionally( &self, batches: &[CommitBatch<'_, Self::Meta>], expected_heads: &[Option<i64>], ) -> Result<Vec<ConditionalCommitOutcome>, ObjectLogError>

Opt-in head compare-and-append. Conditions are next log offsets, not record insertion counters or sparse hints. Partition publication remains independent; this is not a cross-partition transaction. The default rejects any condition before calling the legacy commit implementation.
Source§

fn fence_epoch( &self, partition: &PartitionKey, expected: u64, new_epoch: u64, ) -> Result<(), ObjectLogError>

Move the stored fence epoch for partition from expected to new_epoch. Read more
Source§

fn partition_epoch(&self, partition: &PartitionKey) -> Option<u64>

👎Deprecated since 0.3.6:

the engine no longer reads fence epochs; implement rejection_error instead

The fence epoch this handle last read for partition, if it tracks one. Read more
Source§

fn rejection_error( &self, partition: &PartitionKey, epoch: u64, reason: String, ) -> ObjectLogError

The error the engine reports for a batch this sequencer answered with CommitOutcome::Rejected. epoch is the fence epoch the batch was produced at. Read more
Source§

fn acquire_authoritative_epoch( &self, partition: &PartitionKey, ) -> Result<AuthoritativePartitionState, ObjectLogError>

Acquire a fresh durable writer epoch and the matching bounds from this call’s successful CAS. This grants no ongoing writer exclusivity. An error may follow a durable epoch advance; never infer no effect. Unsupported implementations fail without legacy fence fallback.
Source§

fn authoritative_partition_state( &self, partition: &PartitionKey, ) -> Result<AuthoritativePartitionState, ObjectLogError>

Read validated durable state directly; unsupported implementations fail without invoking legacy refresh or cached getters.
Source§

fn refresh_partition( &self, partition: &PartitionKey, ) -> Result<(), ObjectLogError>

Reload partition’s index from durable storage, so this handle sees commits made by other writers since it opened. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.