Struct aws_sdk_glue::types::SnowflakeNodeData

#[non_exhaustive]
pub struct SnowflakeNodeData {

    pub source_type: Option<String>,
    pub connection: Option<Option>,
    pub schema: Option<String>,
    pub table: Option<String>,
    pub database: Option<String>,
    pub temp_dir: Option<String>,
    pub iam_role: Option<Option>,
    pub additional_options: Option<HashMap<String, String>>,
    pub sample_query: Option<String>,
    pub pre_action: Option<String>,
    pub post_action: Option<String>,
    pub action: Option<String>,
    pub upsert: bool,
    pub merge_action: Option<String>,
    pub merge_when_matched: Option<String>,
    pub merge_when_not_matched: Option<String>,
    pub merge_clause: Option<String>,
    pub staging_table: Option<String>,
    pub selected_columns: Option<Vec<Option>>,
    pub auto_pushdown: bool,
    pub table_schema: Option<Vec<Option>>,
}

Specifies configuration for Snowflake nodes in Glue Studio.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

source_type: Option<String>

Specifies how retrieved data is specified. Valid values: "table", "query".

connection: Option<Option>

Specifies a Glue Data Catalog Connection to a Snowflake endpoint.

schema: Option<String>

Specifies a Snowflake database schema for your node to use.

table: Option<String>

Specifies a Snowflake table for your node to use.

database: Option<String>

Specifies a Snowflake database for your node to use.

temp_dir: Option<String>

Not currently used.

iam_role: Option<Option>

Not currently used.

additional_options: Option<HashMap<String, String>>

Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.

sample_query: Option<String>

A SQL string used to retrieve data with the query sourcetype.

pre_action: Option<String>

A SQL string run before the Snowflake connector performs its standard actions.

post_action: Option<String>

A SQL string run after the Snowflake connector performs its standard actions.

action: Option<String>

Specifies what action to take when writing to a table with preexisting data. Valid values: append, merge, truncate, drop.

upsert: bool

Used when Action is append. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.

merge_action: Option<String>

Specifies a merge action. Valid values: simple, custom. If simple, merge behavior is defined by MergeWhenMatched and MergeWhenNotMatched. If custom, defined by MergeClause.

merge_when_matched: Option<String>

Specifies how to resolve records that match preexisting data when merging. Valid values: update, delete.

merge_when_not_matched: Option<String>

Specifies how to process records that do not match preexisting data when merging. Valid values: insert, none.

merge_clause: Option<String>

A SQL statement that specifies a custom merge behavior.

staging_table: Option<String>

The name of a staging table used when performing merge or upsert append actions. Data is written to this table, then moved to table by a generated postaction.

selected_columns: Option<Vec<Option>>

Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with value, label and description keys. Each structure describes a column.

auto_pushdown: bool

Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.

table_schema: Option<Vec<Option>>

Manually defines the target schema for the node. A list of structures with value , label and description keys. Each structure defines a column.

Implementations

impl SnowflakeNodeData

pub fn source_type(&self) -> Option<&str>

Specifies how retrieved data is specified. Valid values: "table", "query".

pub fn connection(&self) -> Option<&Option>

Specifies a Glue Data Catalog Connection to a Snowflake endpoint.

pub fn schema(&self) -> Option<&str>

Specifies a Snowflake database schema for your node to use.

pub fn table(&self) -> Option<&str>

Specifies a Snowflake table for your node to use.

pub fn database(&self) -> Option<&str>

Specifies a Snowflake database for your node to use.

pub fn temp_dir(&self) -> Option<&str>

Not currently used.

pub fn iam_role(&self) -> Option<&Option>

Not currently used.

pub fn additional_options(&self) -> Option<&HashMap<String, String>>

Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.

pub fn sample_query(&self) -> Option<&str>

A SQL string used to retrieve data with the query sourcetype.

pub fn pre_action(&self) -> Option<&str>

A SQL string run before the Snowflake connector performs its standard actions.

pub fn post_action(&self) -> Option<&str>

A SQL string run after the Snowflake connector performs its standard actions.

pub fn action(&self) -> Option<&str>

Specifies what action to take when writing to a table with preexisting data. Valid values: append, merge, truncate, drop.

pub fn upsert(&self) -> bool

Used when Action is append. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.

pub fn merge_action(&self) -> Option<&str>

Specifies a merge action. Valid values: simple, custom. If simple, merge behavior is defined by MergeWhenMatched and MergeWhenNotMatched. If custom, defined by MergeClause.

pub fn merge_when_matched(&self) -> Option<&str>

Specifies how to resolve records that match preexisting data when merging. Valid values: update, delete.

pub fn merge_when_not_matched(&self) -> Option<&str>

Specifies how to process records that do not match preexisting data when merging. Valid values: insert, none.

pub fn merge_clause(&self) -> Option<&str>

A SQL statement that specifies a custom merge behavior.

pub fn staging_table(&self) -> Option<&str>

The name of a staging table used when performing merge or upsert append actions. Data is written to this table, then moved to table by a generated postaction.

pub fn selected_columns(&self) -> &[Option]

Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with value, label and description keys. Each structure describes a column.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .selected_columns.is_none().

pub fn auto_pushdown(&self) -> bool

Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.

pub fn table_schema(&self) -> &[Option]

Manually defines the target schema for the node. A list of structures with value , label and description keys. Each structure defines a column.

If no value was sent for this field, a default will be set. If you want to determine if no value was sent, use .table_schema.is_none().

impl SnowflakeNodeData

pub fn builder() -> SnowflakeNodeDataBuilder

Creates a new builder-style object to manufacture SnowflakeNodeData.

Trait Implementations

impl Clone for SnowflakeNodeData

fn clone(&self) -> SnowflakeNodeData

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SnowflakeNodeData

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for SnowflakeNodeData

fn eq(&self, other: &SnowflakeNodeData) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SnowflakeNodeData