Enum Expression 

pub enum Expression {
    Literal(LiteralExpression),
    ColumnReference(ColumnReference),
    UnresolvedFunction(UnresolvedFunction),
    UnresolvedStar(Option<String>),
    Alias(Box<Alias>),
    Cast(Box<Cast>),
    DirectShufflePartitionId(Box<Expression>),
    UnresolvedRegex(String),
    SortOrder(Box<SortOrder>),
    CaseWhen(Box<CaseWhen>),
    UnresolvedExtractValue(Box<ExtractValue>),
    UpdateFields(Box<UpdateFieldsExpr>),
    SQLExpression(String),
    CallFunction(Box<CallFunctionWrapper>),
    WindowExpression(Box<WindowExpressionWrapper>),
    LambdaFunction(Box<LambdaFunction>),
    UnresolvedNamedLambdaVariable(UnresolvedNamedLambdaVariable),
    CommonInlineUserDefinedFunction(Box<CommonInlineUserDefinedFunctionExpression>),
}

The base Expression type, mirroring pyspark.sql.connect.expressions.Expression.

All expressions are represented as variants of this enum. Each variant carries the data needed to construct the corresponding proto expression.

Variants

Literal(LiteralExpression)

pyspark.sql.connect.expressions.LiteralExpression - a constant value.

ColumnReference(ColumnReference)

pyspark.sql.connect.expressions.ColumnReference - a reference to a column.

UnresolvedFunction(UnresolvedFunction)

pyspark.sql.connect.expressions.UnresolvedFunction - a function call.

UnresolvedStar(Option<String>)

pyspark.sql.connect.expressions.UnresolvedStar - a star expression (*). Carries an optional target ending in .* (e.g. df.* from col("df.*")).

Alias(Box<Alias>)

pyspark.sql.connect.expressions.ColumnAlias / Alias - an aliased expression.

Cast(Box<Cast>)

pyspark.sql.connect.expressions.CastExpression - a cast expression.

DirectShufflePartitionId(Box<Expression>)

spark.connect.Expression.DirectShufflePartitionID - wraps a child expression that evaluates to a partition id (used by DataFrame.repartitionById).

UnresolvedRegex(String)

pyspark.sql.connect.expressions.UnresolvedRegex - a regex column reference.

SortOrder(Box<SortOrder>)

pyspark.sql.connect.expressions.SortOrder - a sort order expression.

CaseWhen(Box<CaseWhen>)

pyspark.sql.connect.expressions.CaseWhen - a CASE WHEN expression.

UnresolvedExtractValue(Box<ExtractValue>)

pyspark.sql.connect.expressions.UnresolvedExtractValue - col[k] / getField.

UpdateFields(Box<UpdateFieldsExpr>)

pyspark.sql.connect.expressions.UpdateFields - withField / dropFields.

SQLExpression(String)

pyspark.sql.connect.expressions.SQLExpression - a raw SQL expression.

CallFunction(Box<CallFunctionWrapper>)

pyspark.sql.connect.expressions.CallFunction - a direct function call.

WindowExpression(Box<WindowExpressionWrapper>)

pyspark.sql.connect.expressions.WindowExpression - a window function call.

LambdaFunction(Box<LambdaFunction>)

pyspark.sql.connect.expressions.LambdaFunction - a lambda function.

UnresolvedNamedLambdaVariable(UnresolvedNamedLambdaVariable)

pyspark.sql.connect.expressions.UnresolvedNamedLambdaVariable - a lambda variable.

CommonInlineUserDefinedFunction(Box<CommonInlineUserDefinedFunctionExpression>)

pyspark.sql.connect.expressions.CommonInlineUserDefinedFunction - a UDF expression.

Implementations

impl Expression

pub fn render(&self) -> String

Render this expression to a human-readable string, mirroring the __repr__ of pyspark.sql.connect.expressions.*.

This is what Column.__repr__ wraps as Column<'...'>. pandas-on-Spark’s spark_column_equals compares these strings (after stripping backticks) to decide column equality, so the rendering must be deterministic and mirror PySpark’s format for the common operators.

pub fn to_proto(&self) -> Expression

Converts the expression to a Spark Connect protobuf expression.

Trait Implementations

impl Clone for Expression

fn clone(&self) -> Expression

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Expression

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Expression

fn eq(&self, other: &Expression) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Expression