Struct google_bigquery2::api::SparkOptions
source · pub struct SparkOptions {
pub archive_uris: Option<Vec<String>>,
pub connection: Option<String>,
pub container_image: Option<String>,
pub file_uris: Option<Vec<String>>,
pub jar_uris: Option<Vec<String>>,
pub main_file_uri: Option<String>,
pub properties: Option<HashMap<String, String>>,
pub py_file_uris: Option<Vec<String>>,
pub runtime_version: Option<String>,
}
Expand description
Options for a user-defined Spark routine.
This type is not used in any activity, and only used as part of another schema.
Fields§
§archive_uris: Option<Vec<String>>
Archive files to be extracted into the working directory of each executor. For more information about Apache Spark, see Apache Spark.
connection: Option<String>
Fully qualified name of the user-provided Spark connection object. Format: "projects/{project_id}/locations/{location_id}/connections/{connection_id}"
container_image: Option<String>
Custom container image for the runtime environment.
file_uris: Option<Vec<String>>
Files to be placed in the working directory of each executor. For more information about Apache Spark, see Apache Spark.
jar_uris: Option<Vec<String>>
JARs to include on the driver and executor CLASSPATH. For more information about Apache Spark, see Apache Spark.
main_file_uri: Option<String>
The main file/jar URI of the Spark application. Exactly one of the definition_body field and the main_file_uri field must be set for Python. Exactly one of main_class and main_file_uri field should be set for Java/Scala language type.
properties: Option<HashMap<String, String>>
Configuration properties as a set of key/value pairs, which will be passed on to the Spark application. For more information, see Apache Spark.
py_file_uris: Option<Vec<String>>
Python files to be placed on the PYTHONPATH for PySpark application. Supported file types: .py
, .egg
, and .zip
. For more information about Apache Spark, see Apache Spark.
runtime_version: Option<String>
Runtime version. If not specified, the default runtime version is used.
Trait Implementations§
source§impl Clone for SparkOptions
impl Clone for SparkOptions
source§fn clone(&self) -> SparkOptions
fn clone(&self) -> SparkOptions
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read more