Skip to main content

MmapVectorSegment

Struct MmapVectorSegment 

Source
pub struct MmapVectorSegment { /* private fields */ }
Expand description

Memory-mapped vector segment file (v2 NDVS format).

Exposes a &[f32] view of the vector data block and a &[u64] view of the surrogate ID block — both zero-copy slices into the mmap region.

Not Send or Sync — owned by a single Data Plane core.

Implementations§

Source§

impl MmapVectorSegment

Source

pub fn create(path: &Path, dim: usize, vectors: &[&[f32]]) -> Result<Self>

Create a new segment file (surrogates default to 0) and open it.

Source

pub fn create_with_surrogates( path: &Path, dim: usize, vectors: &[&[f32]], surrogate_ids: &[u64], ) -> Result<Self>

Create a new segment file with explicit surrogate IDs and open it.

Source

pub fn create_with_policy( path: &Path, dim: usize, vectors: &[&[f32]], policy: VectorSegmentDropPolicy, ) -> Result<Self>

Create a new segment with an explicit drop policy.

Source

pub fn open(path: &Path) -> Result<Self>

Open an existing segment file and memory-map it.

Source

pub fn open_with_policy( path: &Path, policy: VectorSegmentDropPolicy, ) -> Result<Self>

Open an existing segment with an explicit drop policy.

Source

pub fn open_with_governor( path: &Path, governor: &Arc<MemoryGovernor>, ) -> Result<Self, VectorError>

Open an existing segment with a memory governor.

Reserves file_size bytes in the EngineId::Vector budget before mapping the file. Returns VectorError::BudgetExhausted if the governor rejects the reservation. The reservation is released automatically when the segment is dropped (RAII via BudgetGuard).

Source

pub fn open_with_governor_and_policy( path: &Path, governor: &Arc<MemoryGovernor>, policy: VectorSegmentDropPolicy, ) -> Result<Self, VectorError>

Open an existing segment with a memory governor and explicit drop policy.

Source

pub fn madvise_state(&self) -> Option<c_int>

The madvise hint set on this segment (if any).

Source

pub fn get_vector(&self, id: u32) -> Option<&[f32]>

Get a vector by local index. Returns a slice into the mmap’d region.

Source

pub fn get_surrogate_id(&self, id: u32) -> Option<u64>

Get the surrogate ID for a local index (0-based row in this segment).

Source

pub fn all_vectors_flat(&self) -> &[f32]

The full vector data block as a contiguous &[f32] of length D × N.

Suitable for SIMD distance computation over all vectors.

Source

pub fn all_surrogate_ids(&self) -> &[u64]

The full surrogate ID block as a contiguous &[u64] of length N.

Parallel to all_vectors_flat: row i in vectors ↔ surrogate_ids[i].

Source

pub fn prefetch(&self, id: u32)

Prefetch a vector’s page into memory via madvise(MADV_WILLNEED).

Source

pub fn prefetch_batch(&self, ids: &[u32])

Prefetch a batch of vector IDs.

Source

pub fn dim(&self) -> usize

Source

pub fn count(&self) -> usize

Source

pub fn path(&self) -> &Path

Source

pub fn mmap_bytes(&self) -> usize

Source

pub fn file_size(&self) -> usize

Trait Implementations§

Source§

impl Debug for MmapVectorSegment

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Drop for MmapVectorSegment

Source§

fn drop(&mut self)

Executes the destructor for this type. Read more
Source§

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)
Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
Source§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

Source§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
Source§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more