Struct SparklessConfig 

pub struct SparklessConfig {
    pub warehouse_dir: Option<PathBuf>,
    pub temp_dir: Option<PathBuf>,
    pub case_sensitive: bool,
    pub extra: HashMap<String, String>,
}

Configuration for building a SparkSession.

Can be constructed manually or from environment variables via SparklessConfig::from_env.

Fields

warehouse_dir: Option<PathBuf>

Directory for disk-backed tables (saveAsTable). Maps to spark.sql.warehouse.dir.

temp_dir: Option<PathBuf>

Optional temp directory for intermediate data. Reserved for future use.

case_sensitive: bool

When true, column names are case-sensitive. Default is false (PySpark default). Maps to spark.sql.caseSensitive.

extra: HashMap<String, String>

Extra Spark-style config key-value pairs (e.g. spark.app.name, spark.executor.memory).

Implementations

impl SparklessConfig

pub fn from_env() -> SparklessConfig

Build config from environment variables.

• ROBIN_SPARKLESS_WAREHOUSE_DIR → warehouse_dir
• ROBIN_SPARKLESS_TEMP_DIR → temp_dir
• ROBIN_SPARKLESS_CASE_SENSITIVE → case_sensitive (any value that is “true” or “1” case-insensitively)
• ROBIN_SPARKLESS_CONFIG_* → keys in extra; the key is the suffix after the prefix, with underscores converted to dots (e.g. ROBIN_SPARKLESS_CONFIG_SPARK_APP_NAME → spark.app.name)

pub fn to_session_config(&self) -> HashMap<String, String>

Convert to the session config map (spark.sql.warehouse.dir, spark.sql.caseSensitive, plus extra).

Trait Implementations

impl Clone for SparklessConfig

fn clone(&self) -> SparklessConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparklessConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for SparklessConfig

fn default() -> SparklessConfig

Returns the “default value” for a type.