Struct SparkOptions 

pub struct SparkOptions {
    pub map_key_dedup_policy: MapKeyDedupPolicy,
}

Options controlling DataFusion’s Spark-compatibility layer (functions under datafusion/spark). Keys here mirror their spark.sql.* equivalents in Apache Spark.

Fields

map_key_dedup_policy: MapKeyDedupPolicy

Policy for handling duplicate keys in Spark-compatible map-construction functions (map_from_arrays, map_from_entries, str_to_map).

Mirrors Spark’s spark.sql.mapKeyDedupPolicy:

• EXCEPTION (default): raise [DUPLICATED_MAP_KEY] at runtime on any duplicate key.
• LAST_WIN: keep the last occurrence of each duplicate key.

Values are case-insensitive.

Trait Implementations

impl Clone for SparkOptions

fn clone(&self) -> SparkOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ConfigField for SparkOptions

fn set(&mut self, key: &str, value: &str) -> Result<()>

fn visit<V: Visit>( &self, v: &mut V, key_prefix: &str, _description: &'static str, )

fn reset(&mut self, key: &str) -> Result<()>

impl Debug for SparkOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkOptions

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for SparkOptions

fn eq(&self, other: &SparkOptions) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SparkOptions