pub struct MapLoader;Expand description
Fetch, verify, and cache tokenizer maps.
Implementations§
Source§impl MapLoader
impl MapLoader
Sourcepub fn load_blocking(opts: LoadOptions) -> Result<Arc<TokenizerMap>, LoadError>
pub fn load_blocking(opts: LoadOptions) -> Result<Arc<TokenizerMap>, LoadError>
Synchronous fetch + verify + cache.
Sourcepub async fn load(opts: LoadOptions) -> Result<Arc<TokenizerMap>, LoadError>
pub async fn load(opts: LoadOptions) -> Result<Arc<TokenizerMap>, LoadError>
Async fetch + verify + cache. Requires a Tokio runtime.
Sourcepub fn verify_and_parse(
bytes: &[u8],
expected_hash: Option<&str>,
) -> Result<TokenizerMap, LoadError>
pub fn verify_and_parse( bytes: &[u8], expected_hash: Option<&str>, ) -> Result<TokenizerMap, LoadError>
Verify-only helper exposed for tests / callers that fetched bytes out-of-band (e.g. local file). Returns the map on success or a hash-mismatch error.
Auto Trait Implementations§
impl Freeze for MapLoader
impl RefUnwindSafe for MapLoader
impl Send for MapLoader
impl Sync for MapLoader
impl Unpin for MapLoader
impl UnsafeUnpin for MapLoader
impl UnwindSafe for MapLoader
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more