Struct Classifier

#[non_exhaustive]
pub struct Classifier {
    pub grok_classifier: Option<GrokClassifier>,
    pub xml_classifier: Option<XmlClassifier>,
    pub json_classifier: Option<JsonClassifier>,
    pub csv_classifier: Option<CsvClassifier>,
}

Classifiers are triggered during a crawl task. A classifier checks whether a given file is in a format it can handle. If it is, the classifier creates a schema in the form of a StructType object that matches that data format.

You can use the standard classifiers that Glue provides, or you can write your own classifiers to best categorize your data sources and specify the appropriate schemas to use for them. A classifier can be a grok classifier, an XML classifier, a JSON classifier, or a custom CSV classifier, as specified in one of the fields in the Classifier object.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

grok_classifier: Option<GrokClassifier>

A classifier that uses grok.

xml_classifier: Option<XmlClassifier>

A classifier for XML content.

json_classifier: Option<JsonClassifier>

A classifier for JSON content.

csv_classifier: Option<CsvClassifier>

A classifier for comma-separated values (CSV).

Implementations

impl Classifier

pub fn grok_classifier(&self) -> Option<&GrokClassifier>

A classifier that uses grok.

pub fn xml_classifier(&self) -> Option<&XmlClassifier>

A classifier for XML content.

pub fn json_classifier(&self) -> Option<&JsonClassifier>

A classifier for JSON content.

pub fn csv_classifier(&self) -> Option<&CsvClassifier>

A classifier for comma-separated values (CSV).

impl Classifier

pub fn builder() -> ClassifierBuilder

Creates a new builder-style object to manufacture Classifier.

Trait Implementations

impl Clone for Classifier

fn clone(&self) -> Classifier

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Classifier

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Classifier

fn eq(&self, other: &Classifier) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Classifier