Skip to main content

DirectoryNamespaceBuilder

Struct DirectoryNamespaceBuilder 

Source
pub struct DirectoryNamespaceBuilder { /* private fields */ }
Expand description

Builder for creating a DirectoryNamespace.

This builder provides a fluent API for configuring and establishing connections to directory-based Lance namespaces.

§Examples

// Create a local directory namespace
let namespace = DirectoryNamespaceBuilder::new("/path/to/data")
    .build()
    .await?;
// Create with custom storage options and session
let session = Arc::new(Session::default());
let namespace = DirectoryNamespaceBuilder::new("s3://bucket/path")
    .storage_option("region", "us-west-2")
    .storage_option("access_key_id", "key")
    .session(session)
    .build()
    .await?;

Implementations§

Source§

impl DirectoryNamespaceBuilder

Source

pub fn new(root: impl Into<String>) -> Self

Create a new DirectoryNamespaceBuilder with the specified root path.

§Arguments
  • root - Root directory path (local path or cloud URI like s3://bucket/path)
Source

pub fn manifest_enabled(self, enabled: bool) -> Self

Enable or disable manifest-based listing.

When enabled (default), the namespace uses a __manifest table to track tables. When disabled, relies solely on directory scanning.

Source

pub fn dir_listing_enabled(self, enabled: bool) -> Self

Enable or disable directory-based listing fallback.

When enabled (default), falls back to directory scanning for tables not in the manifest. When disabled, only consults the manifest table.

Source

pub fn inline_optimization_enabled(self, enabled: bool) -> Self

Enable or disable inline optimization of the __manifest table.

When enabled (default), performs compaction and indexing on the __manifest table after every write operation to maintain optimal performance. When disabled, manual optimization must be performed separately.

Source

pub fn from_properties( properties: HashMap<String, String>, session: Option<Arc<Session>>, ) -> Result<Self>

Create a DirectoryNamespaceBuilder from properties HashMap.

This method parses a properties map into builder configuration. It expects:

  • root: The root directory path (required)
  • manifest_enabled: Enable manifest-based table tracking (optional, default: true)
  • dir_listing_enabled: Enable directory listing for table discovery (optional, default: true)
  • inline_optimization_enabled: Enable inline optimization of __manifest table (optional, default: true)
  • storage.*: Storage options (optional, prefix will be stripped)

Credential vendor properties (prefixed with credential_vendor., prefix is stripped):

  • credential_vendor.enabled: Set to “true” to enable credential vending (required)
  • credential_vendor.permission: Permission level: read, write, or admin (default: read)

AWS-specific properties (for s3:// locations):

  • credential_vendor.aws_role_arn: AWS IAM role ARN (required for AWS)
  • credential_vendor.aws_external_id: AWS external ID (optional)
  • credential_vendor.aws_region: AWS region (optional)
  • credential_vendor.aws_role_session_name: AWS role session name (optional)
  • credential_vendor.aws_duration_millis: Credential duration in ms (default: 3600000, range: 15min-12hrs)

GCP-specific properties (for gs:// locations):

  • credential_vendor.gcp_service_account: Service account to impersonate (optional)

Note: GCP uses Application Default Credentials (ADC). To use a service account key file, set the GOOGLE_APPLICATION_CREDENTIALS environment variable before starting. GCP token duration cannot be configured; it’s determined by the STS endpoint (typically 1 hour).

Azure-specific properties (for az:// locations):

  • credential_vendor.azure_account_name: Azure storage account name (required for Azure)
  • credential_vendor.azure_tenant_id: Azure tenant ID (optional)
  • credential_vendor.azure_duration_millis: Credential duration in ms (default: 3600000, up to 7 days)
§Arguments
  • properties - Configuration properties
  • session - Optional Lance session to reuse object store registry
§Returns

Returns a DirectoryNamespaceBuilder instance.

§Errors

Returns an error if the root property is missing.

§Examples
let mut properties = HashMap::new();
properties.insert("root".to_string(), "/path/to/data".to_string());
properties.insert("manifest_enabled".to_string(), "true".to_string());
properties.insert("dir_listing_enabled".to_string(), "false".to_string());
properties.insert("storage.region".to_string(), "us-west-2".to_string());

let namespace = DirectoryNamespaceBuilder::from_properties(properties, None)?
    .build()
    .await?;
Source

pub fn storage_option( self, key: impl Into<String>, value: impl Into<String>, ) -> Self

Add a storage option.

§Arguments
  • key - Storage option key (e.g., “region”, “access_key_id”)
  • value - Storage option value
Source

pub fn storage_options(self, options: HashMap<String, String>) -> Self

Add multiple storage options.

§Arguments
  • options - HashMap of storage options to add
Source

pub fn session(self, session: Arc<Session>) -> Self

Set the Lance session to use for this namespace.

When a session is provided, the namespace will reuse the session’s object store registry, allowing multiple namespaces and datasets to share the same underlying storage connections.

§Arguments
  • session - Arc-wrapped Lance session
Source

pub fn credential_vendor_property( self, key: impl Into<String>, value: impl Into<String>, ) -> Self

Add a credential vendor property.

Use short property names without the credential_vendor. prefix. Common properties: enabled, permission. AWS properties: aws_role_arn, aws_external_id, aws_region, aws_role_session_name, aws_duration_millis. GCP properties: gcp_service_account. Azure properties: azure_account_name, azure_tenant_id, azure_duration_millis.

§Arguments
  • key - Property key (e.g., “enabled”, “aws_role_arn”)
  • value - Property value
§Example
let namespace = DirectoryNamespaceBuilder::new("s3://my-bucket/data")
    .credential_vendor_property("enabled", "true")
    .credential_vendor_property("aws_role_arn", "arn:aws:iam::123456789012:role/MyRole")
    .credential_vendor_property("permission", "read")
    .build()
    .await?;
Source

pub fn credential_vendor_properties( self, properties: HashMap<String, String>, ) -> Self

Add multiple credential vendor properties.

Use short property names without the credential_vendor. prefix.

§Arguments
  • properties - HashMap of credential vendor properties to add
Source

pub fn context_provider(self, provider: Arc<dyn DynamicContextProvider>) -> Self

Set a dynamic context provider for per-request context.

The provider can be used to generate additional context for operations. For DirectoryNamespace, the context is stored but not directly used in operations (unlike RestNamespace where it’s converted to HTTP headers).

§Arguments
  • provider - The context provider implementation
Source

pub async fn build(self) -> Result<DirectoryNamespace>

Build the DirectoryNamespace.

§Returns

Returns a DirectoryNamespace instance.

§Errors

Returns an error if:

  • The root path is invalid
  • Connection to the storage backend fails
  • Storage options are invalid

Trait Implementations§

Source§

impl Clone for DirectoryNamespaceBuilder

Source§

fn clone(&self) -> DirectoryNamespaceBuilder

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for DirectoryNamespaceBuilder

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> Conv for T

Source§

fn conv<T>(self) -> T
where Self: Into<T>,

Converts self into T using Into<T>. Read more
Source§

impl<T> Downcast for T
where T: Any,

Source§

fn into_any(self: Box<T>) -> Box<dyn Any>

Converts Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Converts Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
Source§

fn as_any(&self) -> &(dyn Any + 'static)

Converts &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
Source§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Converts &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
Source§

impl<T> DowncastSend for T
where T: Any + Send,

Source§

fn into_any_send(self: Box<T>) -> Box<dyn Any + Send>

Converts Box<Trait> (where Trait: DowncastSend) to Box<dyn Any + Send>, which can then be downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

Source§

fn into_any_sync(self: Box<T>) -> Box<dyn Any + Sync + Send>

Converts Box<Trait> (where Trait: DowncastSync) to Box<dyn Any + Send + Sync>, which can then be downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Sync + Send>

Converts Arc<Trait> (where Trait: DowncastSync) to Arc<Any>, which can then be downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> FmtForward for T

Source§

fn fmt_binary(self) -> FmtBinary<Self>
where Self: Binary,

Causes self to use its Binary implementation when Debug-formatted.
Source§

fn fmt_display(self) -> FmtDisplay<Self>
where Self: Display,

Causes self to use its Display implementation when Debug-formatted.
Source§

fn fmt_lower_exp(self) -> FmtLowerExp<Self>
where Self: LowerExp,

Causes self to use its LowerExp implementation when Debug-formatted.
Source§

fn fmt_lower_hex(self) -> FmtLowerHex<Self>
where Self: LowerHex,

Causes self to use its LowerHex implementation when Debug-formatted.
Source§

fn fmt_octal(self) -> FmtOctal<Self>
where Self: Octal,

Causes self to use its Octal implementation when Debug-formatted.
Source§

fn fmt_pointer(self) -> FmtPointer<Self>
where Self: Pointer,

Causes self to use its Pointer implementation when Debug-formatted.
Source§

fn fmt_upper_exp(self) -> FmtUpperExp<Self>
where Self: UpperExp,

Causes self to use its UpperExp implementation when Debug-formatted.
Source§

fn fmt_upper_hex(self) -> FmtUpperHex<Self>
where Self: UpperHex,

Causes self to use its UpperHex implementation when Debug-formatted.
Source§

fn fmt_list(self) -> FmtList<Self>
where &'a Self: for<'a> IntoIterator,

Formats each item in a sequence. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<Unshared, Shared> IntoShared<Shared> for Unshared
where Shared: FromUnshared<Unshared>,

Source§

fn into_shared(self) -> Shared

Creates a shared type from an unshared type.
Source§

impl<T> Pipe for T
where T: ?Sized,

Source§

fn pipe<R>(self, func: impl FnOnce(Self) -> R) -> R
where Self: Sized,

Pipes by value. This is generally the method you want to use. Read more
Source§

fn pipe_ref<'a, R>(&'a self, func: impl FnOnce(&'a Self) -> R) -> R
where R: 'a,

Borrows self and passes that borrow into the pipe function. Read more
Source§

fn pipe_ref_mut<'a, R>(&'a mut self, func: impl FnOnce(&'a mut Self) -> R) -> R
where R: 'a,

Mutably borrows self and passes that borrow into the pipe function. Read more
Source§

fn pipe_borrow<'a, B, R>(&'a self, func: impl FnOnce(&'a B) -> R) -> R
where Self: Borrow<B>, B: 'a + ?Sized, R: 'a,

Borrows self, then passes self.borrow() into the pipe function. Read more
Source§

fn pipe_borrow_mut<'a, B, R>( &'a mut self, func: impl FnOnce(&'a mut B) -> R, ) -> R
where Self: BorrowMut<B>, B: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.borrow_mut() into the pipe function. Read more
Source§

fn pipe_as_ref<'a, U, R>(&'a self, func: impl FnOnce(&'a U) -> R) -> R
where Self: AsRef<U>, U: 'a + ?Sized, R: 'a,

Borrows self, then passes self.as_ref() into the pipe function.
Source§

fn pipe_as_mut<'a, U, R>(&'a mut self, func: impl FnOnce(&'a mut U) -> R) -> R
where Self: AsMut<U>, U: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.as_mut() into the pipe function.
Source§

fn pipe_deref<'a, T, R>(&'a self, func: impl FnOnce(&'a T) -> R) -> R
where Self: Deref<Target = T>, T: 'a + ?Sized, R: 'a,

Borrows self, then passes self.deref() into the pipe function.
Source§

fn pipe_deref_mut<'a, T, R>( &'a mut self, func: impl FnOnce(&'a mut T) -> R, ) -> R
where Self: DerefMut<Target = T> + Deref, T: 'a + ?Sized, R: 'a,

Mutably borrows self, then passes self.deref_mut() into the pipe function.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> Tap for T

Source§

fn tap(self, func: impl FnOnce(&Self)) -> Self

Immutable access to a value. Read more
Source§

fn tap_mut(self, func: impl FnOnce(&mut Self)) -> Self

Mutable access to a value. Read more
Source§

fn tap_borrow<B>(self, func: impl FnOnce(&B)) -> Self
where Self: Borrow<B>, B: ?Sized,

Immutable access to the Borrow<B> of a value. Read more
Source§

fn tap_borrow_mut<B>(self, func: impl FnOnce(&mut B)) -> Self
where Self: BorrowMut<B>, B: ?Sized,

Mutable access to the BorrowMut<B> of a value. Read more
Source§

fn tap_ref<R>(self, func: impl FnOnce(&R)) -> Self
where Self: AsRef<R>, R: ?Sized,

Immutable access to the AsRef<R> view of a value. Read more
Source§

fn tap_ref_mut<R>(self, func: impl FnOnce(&mut R)) -> Self
where Self: AsMut<R>, R: ?Sized,

Mutable access to the AsMut<R> view of a value. Read more
Source§

fn tap_deref<T>(self, func: impl FnOnce(&T)) -> Self
where Self: Deref<Target = T>, T: ?Sized,

Immutable access to the Deref::Target of a value. Read more
Source§

fn tap_deref_mut<T>(self, func: impl FnOnce(&mut T)) -> Self
where Self: DerefMut<Target = T> + Deref, T: ?Sized,

Mutable access to the Deref::Target of a value. Read more
Source§

fn tap_dbg(self, func: impl FnOnce(&Self)) -> Self

Calls .tap() only in debug builds, and is erased in release builds.
Source§

fn tap_mut_dbg(self, func: impl FnOnce(&mut Self)) -> Self

Calls .tap_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_borrow_dbg<B>(self, func: impl FnOnce(&B)) -> Self
where Self: Borrow<B>, B: ?Sized,

Calls .tap_borrow() only in debug builds, and is erased in release builds.
Source§

fn tap_borrow_mut_dbg<B>(self, func: impl FnOnce(&mut B)) -> Self
where Self: BorrowMut<B>, B: ?Sized,

Calls .tap_borrow_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_ref_dbg<R>(self, func: impl FnOnce(&R)) -> Self
where Self: AsRef<R>, R: ?Sized,

Calls .tap_ref() only in debug builds, and is erased in release builds.
Source§

fn tap_ref_mut_dbg<R>(self, func: impl FnOnce(&mut R)) -> Self
where Self: AsMut<R>, R: ?Sized,

Calls .tap_ref_mut() only in debug builds, and is erased in release builds.
Source§

fn tap_deref_dbg<T>(self, func: impl FnOnce(&T)) -> Self
where Self: Deref<Target = T>, T: ?Sized,

Calls .tap_deref() only in debug builds, and is erased in release builds.
Source§

fn tap_deref_mut_dbg<T>(self, func: impl FnOnce(&mut T)) -> Self
where Self: DerefMut<Target = T> + Deref, T: ?Sized,

Calls .tap_deref_mut() only in debug builds, and is erased in release builds.
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T> TryConv for T

Source§

fn try_conv<T>(self) -> Result<T, Self::Error>
where Self: TryInto<T>,

Attempts to convert self into T using TryInto<T>. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

impl<G1, G2> Within<G2> for G1
where G2: Contains<G1>,

Source§

fn is_within(&self, b: &G2) -> bool

Source§

impl<T> Fruit for T
where T: Send + Downcast,

Source§

impl<T> MaybeSend for T
where T: Send,