Struct ListingSchemaProvider

pub struct ListingSchemaProvider { /* private fields */ }

A SchemaProvider that scans an ObjectStore to automatically discover tables

A subfolder relationship is assumed, i.e. given:

• authority = s3://host.example.com:3000
• path = /data/tpch
• factory = DeltaTableFactory

A table called “customer” will be registered for the folder: s3://host.example.com:3000/data/tpch/customer

assuming it contains valid deltalake data, i.e:

• s3://host.example.com:3000/data/tpch/customer/part-00000-xxxx.snappy.parquet
• s3://host.example.com:3000/data/tpch/customer/_delta_log/

Implementations

impl ListingSchemaProvider

pub fn new( authority: String, path: Path, factory: Arc<dyn TableProviderFactory>, store: Arc<dyn ObjectStore>, format: String, ) -> Self

Create a new ListingSchemaProvider

Arguments: authority: The scheme (i.e. s3://) + host (i.e. example.com:3000) path: The root path that contains subfolders which represent tables factory: The TableProviderFactory to use to instantiate tables for each subfolder store: The ObjectStore containing the table data format: The FileFormat of the tables has_header: Indicates whether the created external table has the has_header flag enabled

pub async fn refresh(&self, state: &dyn Session) -> Result<()>

Reload table information from ObjectStore

Trait Implementations

impl Debug for ListingSchemaProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl SchemaProvider for ListingSchemaProvider

fn as_any(&self) -> &dyn Any

Returns this SchemaProvider as Any so that it can be downcast to a specific implementation.

fn table_names(&self) -> Vec<String>

Retrieves the list of available table names in this schema.

fn table<'life0, 'life1, 'async_trait>( &'life0 self, name: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Option<Arc<dyn TableProvider>>, DataFusionError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Retrieves a specific table from the schema by name, if it exists, otherwise returns None.

fn register_table( &self, name: String, table: Arc<dyn TableProvider>, ) -> Result<Option<Arc<dyn TableProvider>>>

If supported by the implementation, adds a new table named name to this schema.

fn deregister_table(&self, name: &str) -> Result<Option<Arc<dyn TableProvider>>>

If supported by the implementation, removes the name table from this schema and returns the previously registered TableProvider, if any.

fn table_exist(&self, name: &str) -> bool

Returns true if table exist in the schema provider, false otherwise.

fn owner_name(&self) -> Option<&str>

Returns the owner of the Schema, default is None. This value is reported as part of `information_tables.schemata