Skip to main content

WalWriter

Struct WalWriter 

Source
pub struct WalWriter { /* private fields */ }
Expand description

Append-only WAL writer.

Implementations§

Source§

impl WalWriter

Source

pub fn open(path: &Path, config: WalWriterConfig) -> Result<Self>

Open or create a WAL file at the given path.

Source

pub fn open_resuming( path: &Path, config: WalWriterConfig, declared_first_lsn: u64, ) -> Result<Self>

Resume appending to an existing segment whose filename declares declared_first_lsn as the lowest LSN it may hold.

Self::open derives the next LSN from the records it finds, and a segment that holds none — created by a rollover that was never written to, or one whose every record was torn away — would restart the sequence at 1. Those LSNs are already spoken for by the earlier segments, so replay would see duplicates and truncation would delete the originals. The filename is the authority on where this segment’s range begins, so the resumed sequence never drops below it.

Source

pub fn set_encryption_key(&mut self, key: WalEncryptionKey) -> Result<()>

Set the encryption key. When set, all subsequent records will have their payloads encrypted with AES-256-GCM.

Writes the 16-byte WAL segment preamble at the current file offset. Must be called before the first append. Calling it after records have already been written to this file returns an error.

Source

pub fn set_encryption_ring(&mut self, ring: KeyRing) -> Result<()>

Set the key ring directly (for key rotation with dual-key reads).

Writes the 16-byte WAL segment preamble at the current file offset. Must be called before the first append. Calling it after records have already been written to this file returns an error.

Source

pub fn encryption_ring(&self) -> Option<&KeyRing>

Access the key ring (for decryption during replay).

Source

pub fn segment_preamble(&self) -> Option<&SegmentPreamble>

The preamble for this segment, if encryption was enabled.

Source

pub fn open_with_start_lsn( path: &Path, config: WalWriterConfig, start_lsn: u64, ) -> Result<Self>

Open a new WAL segment file with a specific starting LSN.

Used by SegmentedWal when rolling to a new segment. The file must not already exist (or be empty). The writer will assign LSNs starting from start_lsn.

Source

pub fn open_without_direct_io(path: &Path) -> Result<Self>

Open a WAL writer with O_DIRECT disabled, for a test whose subject is buffered I/O or which runs on a filesystem that refuses the flag.

Source

pub fn append( &mut self, record_type: u32, tenant_id: u64, vshard_id: u32, database_id: u64, payload: &[u8], ) -> Result<u64>

Append a record to the WAL. Returns the assigned LSN.

The record is written to the in-memory buffer. Call sync() to flush to disk and make the write durable.

database_id is stored in header bytes 34-41. Pass 0 for the default database (backward-compatible with pre-existing records).

The LSN is committed only once the record is in the write buffer. An append that fails — a full device, an oversized payload — leaves the LSN sequence untouched, so the next append reuses it rather than leaving a hole that replay would have to reason about.

Source

pub fn append_keyed( &mut self, target: RecordTarget, payload: &[u8], apply_key: u64, ) -> Result<u64>

Self::append for a record appended by the apply of the replicated proposal apply_key, carrying the event source in target (see WalRecord::new_stamped).

Source

pub fn sync(&mut self) -> Result<()>

Flush the write buffer to disk (group commit).

This issues a single write + fsync for all records accumulated since the last flush. The DWB is also fsynced (one fsync for all deferred DWB writes in this batch).

An empty buffer alone does not mean there is nothing to do: a flush clears the buffer before the fsync runs, so a batch whose fsync failed leaves the writer empty-buffered with its records still only in the page cache. Returning early there would report durability the log does not have, so the fsync is skipped only when nothing is outstanding.

Source

pub fn seal(&mut self) -> Result<()>

Seal the WAL — no more writes will be accepted.

Flushes any buffered data before sealing. Sealing is a durability boundary — the next segment starts where this one stops — so it goes through sync, which fsyncs an outstanding flush even when the buffer is empty and refuses to succeed on a poisoned writer.

Source

pub fn next_lsn(&self) -> u64

The next LSN that will be assigned.

Source

pub fn file_offset(&self) -> u64

Current file size (bytes written to disk).

Source

pub fn max_payload(&self) -> usize

The largest payload one record takes: the write buffer, less the padding and anchor reserves, the header and the encryption tag.

Source§

impl WalWriter

Source

pub fn dwb_protection(&self) -> DwbProtection

Torn-write protection standing of this writer.

Source

pub fn dwb_unprotected_records(&self) -> u64

Records appended to this segment with no double-write copy behind them.

Non-zero means those records cannot be reconstructed if they are torn by a power loss at the tail of the segment.

Source

pub fn reattach_double_write(&mut self) -> DwbProtection

Reopen a double-write buffer that was detached after a failure.

Detaching keeps a broken device from being hammered once per append, but on its own it makes degradation permanent for the life of the writer — an operator who has fixed the fault would have no way back short of rolling the segment. Returns the resulting standing.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
Source§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

Source§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
Source§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more