Struct SparkSession 

pub struct SparkSession { /* private fields */ }

Represents a logical connection to a Spark Connect backend.

SparkSession is the main entry point for executing commands, analyzing queries, and retrieving results from Spark Connect.

It wraps an internal SparkClient and tracks session state (such as the session_id).

Examples

use spark_connect::SparkSessionBuilder;

let session = SparkSessionBuilder::new("sc://localhost:15002")
    .build()
    .await
    .unwrap();

println!("Session ID: {}", session.session_id());

Implementations

impl SparkSession

pub fn session_id(&self) -> String

Returns the unique session identifier for this connection.

pub async fn sql( &self, query: &str, params: Vec<Literal>, ) -> Result<Plan, SparkError>

Execute a SQL query and return a lazy plan.

pub fn query(&self, query: &str) -> SqlQueryBuilder<'_>

Alternative “sqlx-like” query interface. Returns a SqlQueryBuilder to bind() parameters and execute().

pub async fn collect(&self, plan: Plan) -> Result<Vec<RecordBatch>, SparkError>

Collect the results from a lazy plan.

pub async fn interrupt_all(&self) -> Result<Vec<String>, SparkError>

Interrupt all running operations.

pub async fn interrupt_operation( &self, op_id: &str, ) -> Result<Vec<String>, SparkError>

Interrupt a specific operation by ID.

pub async fn version(&self) -> Result<String, SparkError>

Request the version of the Spark Connect server.

Trait Implementations

impl Clone for SparkSession

fn clone(&self) -> SparkSession

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkSession

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.