Crate exon

Exon is a library to facilitate open-ended analysis of scientific data, ease the application of ML models, and provide a common data interface for science and engineering teams.

Overview

The main interface for users is through datafusion’s SessionContext plus the ExonSessionExt extension trait. This has a number of convenience methods for loading data from various sources.

See the read_* methods on ExonSessionExt for more information. For example, read_fasta, or read_gff. There’s also a read_inferred_exon_table method that will attempt to infer the data type and compression from the file extension for ease of use.

To facilitate those methods, Exon implements a number of traits for DataFusion that serve as a good base for scientific data work. See the datasources module for more information.

Modules

• datasources
  Data sources for Exon. Datasources module.
• ffi
  Utilities for moving data across the FFI boundary.
• physical_optimizer
  Physical plan optimizations for Exon.
• physical_plan
  Physical plan augmentations for Exon.
• streaming_bgzf
  Utilities for working with stream bgzf files.
• udfs
  UDFs for Exon. User-defined functions (UDFs) for Exon.

Enums

• ExonError
  Possible errors for Exon.

Traits

• ExonRuntimeEnvExt
  Extension trait for RuntimeEnv that provides additional methods for Exon use-cases.
• ExonSessionExt
  Extension trait for SessionContext that adds Exon-specific functionality.

Functions

• new_exon_config
  Create a new SessionConfig for the exon.

Type Aliases

• Result
  Result type for Exon.