lindera-binding-core 4.0.0

Shared FFI-independent helpers for the Lindera language bindings.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

//! FFI-independent helpers shared by the Lindera language bindings
//! (`lindera-python`, `lindera-php`, `lindera-ruby`, `lindera-nodejs`,
//! `lindera-wasm`).
//!
//! Each binding wraps the core `lindera` crate for its own FFI layer (PyO3,
//! ext-php-rs, magnus, napi, wasm-bindgen) and historically reimplemented the
//! same pure-Rust conversion logic. This crate holds that shared logic as
//! plain Rust so it can be unit-tested without any FFI toolchain.

pub mod error;
pub mod metadata;
pub mod schema;
pub mod token;
pub mod tokenizer;

pub use error::{CoreError, CoreResult, ErrorKind};
pub use metadata::CoreMetadata;
pub use schema::{CoreFieldDefinition, CoreFieldType, CoreSchema};
pub use token::TokenView;
pub use tokenizer::{CoreTokenizer, CoreTokenizerBuilder};