Crate datafusion_delta_sharing

This create provides the integration between Delta Sharing and DataFusion.

Delta Sharing is an open protocol for securely sharing large datasets. It is a REST protocol that securely provides access to a part of a cloud dataset stored on popular cloud storage systems like S3, ADLS, and GCS.

An example of the integration is shown below:

use std::sync::Arc;
use datafusion::prelude::*;

use datafusion_delta_sharing::DeltaSharingTable;

let ctx = SessionContext::new();
let table = DeltaSharingTable::try_from_str("./path/to/profile.share#share.schema.table").await?;

ctx.register_table("demo", Arc::new(table))?;
let data = ctx.sql("select * from demo").await?.collect().await?;

Re-exports

• pub use datasource::DeltaSharingTable;
• pub use error::DeltaSharingError;
• pub use error::DeltaSharingErrorKind;
• pub use profile::Profile;

Modules

• catalog
  Datafusion catalog providers for Delta Sharing.
• client
  Delta Sharing Client
• datasource
  Datafusion TableProvider for Delta Sharing
• error
  Delta Sharing errors types
• profile
  Delta Sharing profile types
• securable
  Delta Sharing shared object types