pub struct SegmentsManifest { /* private fields */ }Expand description
Contents of segments_manifest.json: a flat map of segment UUID to its state, e.g.
{ "1b4e28ba-...": "active", "6ba7b810-...": "active" }.
§Consistency assumptions (important for readers)
The manifest is not an exact, instantaneous snapshot of the on-disk segment set. To guarantee that no data is ever lost across the non-atomic create/delete transitions, it deliberately errs on the side of listing more segments than strictly necessary:
- May list a segment that is not yet fully created. A new segment is registered here as soon as it exists on disk — potentially before its version file is written (i.e. before it is finalized). This guarantees a real, writable segment is never missing from the manifest. A reader must therefore tolerate a listed segment that is incomplete / not yet loadable and skip it (a segment without a saved version is not ready to read).
- May list a segment that has already been (or is about to be) deleted. Removal from the manifest is intentionally not strict: a superseded segment may linger in the manifest after its data has been dropped, or be dropped from disk slightly after it leaves the manifest. A reader must tolerate a listed segment that no longer exists on disk and skip it.
In other words: the manifest is a superset-biased view. Over-listing (duplicate/extra segments) is always safe and is resolved by point versioning during reads; under-listing a live segment is the only thing that would lose data, and the writer ordering prevents it. Readers must handle both of the above cases gracefully rather than assuming every listed segment is present and ready.
Implementations§
Source§impl SegmentsManifest
impl SegmentsManifest
Sourcepub fn from_segment_holder(holder: &SegmentHolder) -> Self
pub fn from_segment_holder(holder: &SegmentHolder) -> Self
Build a manifest from the current live segments in the holder, marking every segment
Active.
Includes segments temporarily wrapped as proxies during optimization — they are still live.
Sourcepub fn set(
&mut self,
uuid: Uuid,
state: SegmentManifestState,
) -> Option<SegmentManifestState>
pub fn set( &mut self, uuid: Uuid, state: SegmentManifestState, ) -> Option<SegmentManifestState>
Set uuid’s state, returning the previous one.
Sourcepub fn remove(&mut self, uuid: &Uuid) -> Option<SegmentManifestState>
pub fn remove(&mut self, uuid: &Uuid) -> Option<SegmentManifestState>
Remove uuid’s entry, returning its state.
Sourcepub fn preserving(self, previous: &SegmentsManifest) -> Self
pub fn preserving(self, previous: &SegmentsManifest) -> Self
Merge rule for persisting a rebuild: a rebuild from the segment holder marks every live
segment Active, which would erase an out-of-process optimizer’s marks. Re-apply
previous’s optimizer marks (Optimizing/Retiring) to segments this manifest still
lists; marks for segments gone from the holder drop with them. Staleness is governed by
the lease, not by rebuilds.
Sourcepub fn sync(
manifest: Option<&Arc<SaveOnDisk<SegmentsManifest>>>,
holder: &SegmentHolder,
extra_segment: Option<Uuid>,
) -> OperationResult<()>
pub fn sync( manifest: Option<&Arc<SaveOnDisk<SegmentsManifest>>>, holder: &SegmentHolder, extra_segment: Option<Uuid>, ) -> OperationResult<()>
Rebuild the manifest from holder and persist it if it changed.
No-op when manifest is None (the write_segment_manifest flag is off). Errors
propagate so callers that gate destructive work (e.g. deleting superseded segments) on a
fresh manifest can abort instead of risking a stale manifest.
Idempotent and cheap: it only writes when the live segment set differs from what is
persisted, so it is safe to call on every relevant segment-set transition. Usually invoked
via [SegmentHolder::sync_segment_manifest], which owns the manifest.
pub fn get(&self, uuid: &Uuid) -> Option<SegmentManifestState>
pub fn iter(&self) -> impl Iterator<Item = (&Uuid, &SegmentManifestState)>
pub fn len(&self) -> usize
pub fn is_empty(&self) -> bool
Trait Implementations§
Source§impl Clone for SegmentsManifest
impl Clone for SegmentsManifest
Source§fn clone(&self) -> SegmentsManifest
fn clone(&self) -> SegmentsManifest
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for SegmentsManifest
impl Debug for SegmentsManifest
Source§impl Default for SegmentsManifest
impl Default for SegmentsManifest
Source§fn default() -> SegmentsManifest
fn default() -> SegmentsManifest
Source§impl<'de> Deserialize<'de> for SegmentsManifest
impl<'de> Deserialize<'de> for SegmentsManifest
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
impl Eq for SegmentsManifest
Source§impl FromIterator<(Uuid, SegmentManifestState)> for SegmentsManifest
impl FromIterator<(Uuid, SegmentManifestState)> for SegmentsManifest
Source§fn from_iter<I: IntoIterator<Item = (Uuid, SegmentManifestState)>>(
iter: I,
) -> Self
fn from_iter<I: IntoIterator<Item = (Uuid, SegmentManifestState)>>( iter: I, ) -> Self
Source§impl PartialEq for SegmentsManifest
impl PartialEq for SegmentsManifest
Source§impl Serialize for SegmentsManifest
impl Serialize for SegmentsManifest
impl StructuralPartialEq for SegmentsManifest
Auto Trait Implementations§
impl Freeze for SegmentsManifest
impl RefUnwindSafe for SegmentsManifest
impl Send for SegmentsManifest
impl Sync for SegmentsManifest
impl Unpin for SegmentsManifest
impl UnsafeUnpin for SegmentsManifest
impl UnwindSafe for SegmentsManifest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<T> FmtForward for T
impl<T> FmtForward for T
Source§fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
fn fmt_binary(self) -> FmtBinary<Self>where
Self: Binary,
self to use its Binary implementation when Debug-formatted.Source§fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
fn fmt_display(self) -> FmtDisplay<Self>where
Self: Display,
self to use its Display implementation when
Debug-formatted.Source§fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
fn fmt_lower_exp(self) -> FmtLowerExp<Self>where
Self: LowerExp,
self to use its LowerExp implementation when
Debug-formatted.Source§fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
fn fmt_lower_hex(self) -> FmtLowerHex<Self>where
Self: LowerHex,
self to use its LowerHex implementation when
Debug-formatted.Source§fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
fn fmt_octal(self) -> FmtOctal<Self>where
Self: Octal,
self to use its Octal implementation when Debug-formatted.Source§fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
fn fmt_pointer(self) -> FmtPointer<Self>where
Self: Pointer,
self to use its Pointer implementation when
Debug-formatted.Source§fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
fn fmt_upper_exp(self) -> FmtUpperExp<Self>where
Self: UpperExp,
self to use its UpperExp implementation when
Debug-formatted.Source§fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
fn fmt_upper_hex(self) -> FmtUpperHex<Self>where
Self: UpperHex,
self to use its UpperHex implementation when
Debug-formatted.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pipe for Twhere
T: ?Sized,
impl<T> Pipe for Twhere
T: ?Sized,
Source§fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> Rwhere
Self: Sized,
Source§fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> Rwhere
R: 'a,
self and passes that borrow into the pipe function. Read moreSource§fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
Source§fn pipe_borrow_mut<'a, B, R>(
&'a mut self,
func: impl FnOnce(&'a mut B) -> R,
) -> R
fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
Source§fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
self, then passes self.as_ref() into the pipe function.Source§fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
self, then passes self.as_mut() into the pipe
function.Source§fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
self, then passes self.deref() into the pipe function.Source§impl<T> Pointable for T
impl<T> Pointable for T
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<T> Serialize for T
impl<T> Serialize for T
fn erased_serialize(&self, serializer: &mut dyn Serializer) -> Result<(), Error>
fn do_erased_serialize( &self, serializer: &mut dyn Serializer, ) -> Result<(), ErrorImpl>
Source§impl<T> Tap for T
impl<T> Tap for T
Source§fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
Borrow<B> of a value. Read moreSource§fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
BorrowMut<B> of a value. Read moreSource§fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
AsRef<R> view of a value. Read moreSource§fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
AsMut<R> view of a value. Read moreSource§fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
Deref::Target of a value. Read moreSource§fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self
.tap() only in debug builds, and is erased in release builds.Source§fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self
.tap_mut() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
.tap_borrow() only in debug builds, and is erased in release
builds.Source§fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
.tap_borrow_mut() only in debug builds, and is erased in release
builds.Source§fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
.tap_ref() only in debug builds, and is erased in release
builds.Source§fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
.tap_ref_mut() only in debug builds, and is erased in release
builds.Source§fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
.tap_deref() only in debug builds, and is erased in release
builds.