Struct google_cloud_bigquery::http::routine::SparkOptions

pub struct SparkOptions {
    pub connection: Option<String>,
    pub runtime_version: Option<String>,
    pub container_image: Option<String>,
    pub properties: Option<HashMap<String, String>>,
    pub main_file_uri: Option<String>,
    pub py_file_uris: Option<Vec<String>>,
    pub jar_uris: Option<Vec<String>>,
    pub file_uris: Option<Vec<String>>,
    pub archive_uris: Option<Vec<String>>,
    pub main_class: Option<String>,
}

Fields

connection: Option<String>

Fully qualified name of the user-provided Spark connection object. Format: “projects/{projectId}/locations/{locationId}/connections/{connectionId}”

runtime_version: Option<String>

Runtime version. If not specified, the default runtime version is used.

container_image: Option<String>

Custom container image for the runtime environment.

properties: Option<HashMap<String, String>>

Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark and the procedure option list. An object containing a list of “key”: value pairs. Example: { “name”: “wrench”, “mass”: “1.3kg”, “count”: “3” }.

main_file_uri: Option<String>

The main file/jar URI of the Spark application. Exactly one of the definitionBody field and the mainFileUri field must be set for Python. Exactly one of mainClass and mainFileUri field should be set for Java/Scala language type.

py_file_uris: Option<Vec<String>>

Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py, .egg, and .zip. For more information about Apache Spark, see Apache Spark.

jar_uris: Option<Vec<String>>

JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.

file_uris: Option<Vec<String>>

Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.

archive_uris: Option<Vec<String>>

Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.

main_class: Option<String>

The fully qualified name of a class in jarUris, for example, com.example.wordcount. Exactly one of mainClass and main_jar_uri field should be set for Java/Scala language type.

Trait Implementations

impl Clone for SparkOptions

fn clone(&self) -> SparkOptions

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SparkOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SparkOptions

fn default() -> SparkOptions

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for SparkOptions

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for SparkOptions

fn eq(&self, other: &SparkOptions) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for SparkOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for SparkOptions

impl StructuralPartialEq for SparkOptions