1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108
// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership. The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing,
// software distributed under the License is distributed on an
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
// KIND, either express or implied. See the License for the
// specific language governing permissions and limitations
// under the License.
use std::collections::HashMap;
use std::fmt::{self, Display};
use std::hash::{Hash, Hasher};
use std::sync::Arc;
use datafusion_common::config::FormatOptions;
use datafusion_common::{DFSchemaRef, TableReference};
use crate::LogicalPlan;
/// Operator that copies the contents of a database to file(s)
#[derive(Clone)]
pub struct CopyTo {
/// The relation that determines the tuples to write to the output file(s)
pub input: Arc<LogicalPlan>,
/// The location to write the file(s)
pub output_url: String,
/// Determines which, if any, columns should be used for hive-style partitioned writes
pub partition_by: Vec<String>,
/// File format options.
pub format_options: FormatOptions,
/// SQL Options that can affect the formats
pub options: HashMap<String, String>,
}
// Implement PartialEq manually
impl PartialEq for CopyTo {
fn eq(&self, other: &Self) -> bool {
self.input == other.input && self.output_url == other.output_url
}
}
// Implement Eq (no need for additional logic over PartialEq)
impl Eq for CopyTo {}
// Implement Hash manually
impl Hash for CopyTo {
fn hash<H: Hasher>(&self, state: &mut H) {
self.input.hash(state);
self.output_url.hash(state);
}
}
/// The operator that modifies the content of a database (adapted from
/// substrait WriteRel)
#[derive(Clone, PartialEq, Eq, Hash)]
pub struct DmlStatement {
/// The table name
pub table_name: TableReference,
/// The schema of the table (must align with Rel input)
pub table_schema: DFSchemaRef,
/// The type of operation to perform
pub op: WriteOp,
/// The relation that determines the tuples to add/remove/modify the schema must match with table_schema
pub input: Arc<LogicalPlan>,
}
impl DmlStatement {
/// Return a descriptive name of this [`DmlStatement`]
pub fn name(&self) -> &str {
self.op.name()
}
}
#[derive(Clone, PartialEq, Eq, Hash)]
pub enum WriteOp {
InsertOverwrite,
InsertInto,
Delete,
Update,
Ctas,
}
impl WriteOp {
/// Return a descriptive name of this [`WriteOp`]
pub fn name(&self) -> &str {
match self {
WriteOp::InsertOverwrite => "Insert Overwrite",
WriteOp::InsertInto => "Insert Into",
WriteOp::Delete => "Delete",
WriteOp::Update => "Update",
WriteOp::Ctas => "Ctas",
}
}
}
impl Display for WriteOp {
fn fmt(&self, f: &mut fmt::Formatter<'_>) -> fmt::Result {
write!(f, "{}", self.name())
}
}