Struct SparkTaskConfig 

#[non_exhaustive]
pub struct SparkTaskConfig {
    pub file_uris: Vec<String>,
    pub archive_uris: Vec<String>,
    pub infrastructure_spec: Option<InfrastructureSpec>,
    pub driver: Option<Driver>,
    /* private fields */
}

User-specified config for running a Spark task.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

file_uris: Vec<String>

Optional. Cloud Storage URIs of files to be placed in the working directory of each executor.

archive_uris: Vec<String>

Optional. Cloud Storage URIs of archives to be extracted into the working directory of each executor. Supported file types: .jar, .tar, .tar.gz, .tgz, and .zip.

infrastructure_spec: Option<InfrastructureSpec>

Optional. Infrastructure specification for the execution.

driver: Option<Driver>

Required. The specification of the main method to call to drive the job. Specify either the jar file that contains the main class or the main class name.

Implementations

impl SparkTaskConfig

pub fn new() -> Self

pub fn set_file_uris<T, V>(self, v: T) -> Self

where T: IntoIterator<Item = V>, V: Into<String>,

Sets the value of file_uris.

pub fn set_archive_uris<T, V>(self, v: T) -> Self

where T: IntoIterator<Item = V>, V: Into<String>,

Sets the value of archive_uris.

pub fn set_infrastructure_spec<T>(self, v: T) -> Self

where T: Into<InfrastructureSpec>,

Sets the value of infrastructure_spec.

pub fn set_or_clear_infrastructure_spec<T>(self, v: Option<T>) -> Self

where T: Into<InfrastructureSpec>,

Sets or clears the value of infrastructure_spec.

pub fn set_driver<T: Into<Option<Driver>>>(self, v: T) -> Self

Sets the value of driver.

Note that all the setters affecting driver are mutually exclusive.

pub fn main_jar_file_uri(&self) -> Option<&String>

The value of driver if it holds a MainJarFileUri, None if the field is not set or holds a different branch.

pub fn set_main_jar_file_uri<T: Into<String>>(self, v: T) -> Self

Sets the value of driver to hold a MainJarFileUri.

Note that all the setters affecting driver are mutually exclusive.

pub fn main_class(&self) -> Option<&String>

The value of driver if it holds a MainClass, None if the field is not set or holds a different branch.

pub fn set_main_class<T: Into<String>>(self, v: T) -> Self

Sets the value of driver to hold a MainClass.

Note that all the setters affecting driver are mutually exclusive.

pub fn python_script_file(&self) -> Option<&String>

The value of driver if it holds a PythonScriptFile, None if the field is not set or holds a different branch.

pub fn set_python_script_file<T: Into<String>>(self, v: T) -> Self

Sets the value of driver to hold a PythonScriptFile.

Note that all the setters affecting driver are mutually exclusive.

pub fn sql_script_file(&self) -> Option<&String>

The value of driver if it holds a SqlScriptFile, None if the field is not set or holds a different branch.

pub fn set_sql_script_file<T: Into<String>>(self, v: T) -> Self

Sets the value of driver to hold a SqlScriptFile.

Note that all the setters affecting driver are mutually exclusive.

pub fn sql_script(&self) -> Option<&String>

The value of driver if it holds a SqlScript, None if the field is not set or holds a different branch.

pub fn set_sql_script<T: Into<String>>(self, v: T) -> Self

Sets the value of driver to hold a SqlScript.

Note that all the setters affecting driver are mutually exclusive.

Trait Implementations

impl Clone for SparkTaskConfig

fn clone(&self) -> SparkTaskConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkTaskConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkTaskConfig

fn default() -> SparkTaskConfig

Returns the “default value” for a type.

impl Message for SparkTaskConfig

fn typename() -> &'static str

The typename of this message.

impl PartialEq for SparkTaskConfig

fn eq(&self, other: &SparkTaskConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SparkTaskConfig