pub struct SegmentBuilder { /* private fields */ }Expand description
Segment builder with optimized memory usage
Features:
- Streams documents to disk immediately (no in-memory document storage)
- Uses string interning for terms (reduced allocations)
- Uses hashbrown HashMap (faster than BTreeMap)
Implementations§
Source§impl SegmentBuilder
impl SegmentBuilder
Sourcepub fn new(schema: Schema, config: SegmentBuilderConfig) -> Result<Self>
pub fn new(schema: Schema, config: SegmentBuilderConfig) -> Result<Self>
Create a new segment builder
pub fn set_tokenizer(&mut self, field: Field, tokenizer: BoxedTokenizer)
pub fn num_docs(&self) -> u32
Sourcepub fn stats(&self) -> SegmentBuilderStats
pub fn stats(&self) -> SegmentBuilderStats
Get current statistics for debugging performance
Sourcepub fn add_document(&mut self, doc: Document) -> Result<DocId>
pub fn add_document(&mut self, doc: Document) -> Result<DocId>
Add a document - streams to disk immediately
Sourcepub async fn build<D: Directory + DirectoryWriter>(
self,
dir: &D,
segment_id: SegmentId,
) -> Result<SegmentMeta>
pub async fn build<D: Directory + DirectoryWriter>( self, dir: &D, segment_id: SegmentId, ) -> Result<SegmentMeta>
Build the final segment
Trait Implementations§
Auto Trait Implementations§
impl Freeze for SegmentBuilder
impl !RefUnwindSafe for SegmentBuilder
impl Send for SegmentBuilder
impl Sync for SegmentBuilder
impl Unpin for SegmentBuilder
impl !UnwindSafe for SegmentBuilder
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.