Crate sqlite_vtable_opendal 

sqlite-vtable-opendal

Federated SQLite Virtual Tables for Cloud Object Stores using OpenDAL

This library provides a lightweight way to query metadata from cloud object stores (Dropbox, S3, etc.) using SQL without ingesting the data. It uses OpenDAL as the storage abstraction layer and SQLite’s virtual table interface.

Features

• Metadata-only queries: Query file metadata without downloading content
• Multiple backends: Dropbox, S3, Google Drive, Local FS, and more
• Standard SQL: Use familiar SQL syntax for cloud storage queries
• Pagination support: Handle large directories efficiently
• Zero data ingestion: Query directly from cloud without materialization

Example

use rusqlite::Connection;

let conn = Connection::open_in_memory()?;

// Backend implementations will provide their own registration functions
// For example with Dropbox backend:
// dropbox_vtab::register(&conn)?;

// Query cloud storage metadata using standard SQL
let mut stmt = conn.prepare("
    SELECT path, size FROM dropbox_files
    WHERE size > 10000000
    ORDER BY size DESC
")?;

Re-exports

pub use types::FileMetadata;

pub use types::QueryConfig;

pub use error::VTableError;

pub use error::Result;

Modules

backends

Storage backend implementations

error

Error types for the library

types

Core types and data structures for the virtual table

vtab

SQLite virtual table implementation