Crate datafusion_delta_sharing

Source
Expand description

This create provides the integration between Delta Sharing and DataFusion.

Delta Sharing is an open protocol for securely sharing large datasets. It is a REST protocol that securely provides access to a part of a cloud dataset stored on popular cloud storage systems like S3, ADLS, and GCS.

An example of the integration is shown below:

use std::sync::Arc;
use datafusion::prelude::*;

use datafusion_delta_sharing::DeltaSharingTable;

let ctx = SessionContext::new();
let table = DeltaSharingTable::try_from_str("./path/to/profile.share#share.schema.table").await?;

ctx.register_table("demo", Arc::new(table))?;
let data = ctx.sql("select * from demo").await?.collect().await?;

Re-exports§

pub use datasource::DeltaSharingTable;
pub use error::DeltaSharingError;
pub use error::DeltaSharingErrorKind;
pub use profile::Profile;

Modules§

catalog
Datafusion catalog providers for Delta Sharing.
client
Delta Sharing Client
datasource
Datafusion TableProvider for Delta Sharing
error
Delta Sharing errors types
profile
Delta Sharing profile types
securable
Delta Sharing shared object types