Struct RbToken 

pub struct RbToken { /* private fields */ }

Token object wrapping the Rust Token data.

This class provides access to token fields and details.

Implementations

impl RbToken

pub fn from_token(token: Token<'_>) -> Self

Creates a new RbToken from a Lindera Token.

Arguments

• token - Lindera token to convert.

Returns

A new RbToken instance.

Trait Implementations

impl DataTypeFunctions for RbToken

fn free(self: Box<Self>)

Called when the Ruby wrapper object is garbage collected.

fn mark(&self, marker: &Marker)

Called when Ruby marks this object as part of garbage collection.

fn size(&self) -> usize

Called by Ruby to establish the memory size of this data, to optimise when garbage collection happens.

fn compact(&self, compactor: &Compactor)

Called during garbage collection.

impl TypedData for RbToken

fn class(ruby: &Ruby) -> RClass

Should return the class for the Ruby object wrapping the Rust type.

fn data_type() -> &'static DataType

Should return a static reference to a DataType with metadata about the wrapped type.

fn class_for(ruby: &Ruby, value: &Self) -> RClass

Used to customise the class wrapping a specific value of Self.