Struct aws_sdk_glue::model::SparkSql

#[non_exhaustive]
pub struct SparkSql { /* private fields */ }

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

Implementations

impl SparkSql

pub fn name(&self) -> Option<&str>

The name of the transform node.

pub fn inputs(&self) -> Option<&[String]>

The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

pub fn sql_query(&self) -> Option<&str>

A SQL query that must use Spark SQL syntax and return a single data set.

pub fn sql_aliases(&self) -> Option<&[SqlAlias]>

A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

select * from SqlName

and that gets data from MyDataSource.

pub fn output_schemas(&self) -> Option<&[GlueSchema]>

Specifies the data schema for the SparkSQL transform.

impl SparkSql

pub fn builder() -> Builder

Creates a new builder-style object to manufacture SparkSql.

Trait Implementations

impl Clone for SparkSql

fn clone(&self) -> SparkSql

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkSql

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<SparkSql> for SparkSql

fn eq(&self, other: &SparkSql) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SparkSql