Struct SparkSessionBuilder

pub struct SparkSessionBuilder {
    pub channel_builder: ChannelBuilder,
    /* private fields */
}

SparkSessionBuilder creates a remote Spark Session a connection string.

The connection string is define based on the requirements from Spark Documentation

Fields

channel_builder: ChannelBuilder

Implementations

impl SparkSessionBuilder

pub fn remote(connection: &str) -> Self

Validate a connect string for a remote Spark Session

String must conform to the Spark Documentation

pub fn config(self, key: &str, value: &str) -> Self

Sets a config option.

pub fn app_name(self, name: &str) -> Self

Sets a name for the application, which will be shown in the Spark web UI.

pub async fn build(&self) -> Result<SparkSession, SparkError>

Attempt to connect to a remote Spark Session

and return a SparkSession

Trait Implementations

impl Clone for SparkSessionBuilder

fn clone(&self) -> SparkSessionBuilder

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkSessionBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkSessionBuilder

Default connects a Spark cluster running at sc://127.0.0.1:15002/

fn default() -> Self

Returns the “default value” for a type.