Crate skippy_ffi

Source

Structs§

Enums§

ActivationDType
ActivationLayout
BackendDeviceType
GgmlType
LlamaFileType
LlamaModelKvOverrideType
LoadMode
MtmdInputChunkType
NativeRuntimeLoadError
Status
TensorRole

Constants§

ABI_VERSION_MAJOR
ABI_VERSION_MINOR
ABI_VERSION_PATCH
ACTIVATION_FLAG_INKLING_MTP_EMBD
BACKEND_DEVICE_CAP_ASYNC
BACKEND_DEVICE_CAP_BUFFER_FROM_HOST_PTR
BACKEND_DEVICE_CAP_EVENTS
BACKEND_DEVICE_CAP_HOST_BUFFER
FEATURE_BACKEND_DEVICES
FEATURE_INKLING_MTP_MM
FEATURE_NATIVE_MTP_N1
FEATURE_NGRAM_CACHE_DRAFT
FEATURE_RUNTIME_EVENTS
NATIVE_MTP_MAX_DRAFT_TOKENS

Functions§

abi_features: Returns the active Skippy ABI feature bitmask through a safe Rust wrapper.
ggml_log_set^⚠
llama_log_set^⚠
llama_model_quantize^⚠
llama_model_quantize_default_params^⚠
load_native_runtime_libraries^⚠: Load native runtime libraries and resolve Skippy ABI symbols from them.
load_native_runtime_library^⚠: Load a native runtime library and resolve the Skippy ABI symbols from it.
mtmd_bitmap_free^⚠
mtmd_context_params_default^⚠
mtmd_decode_use_mrope^⚠
mtmd_default_marker^⚠
mtmd_free^⚠
mtmd_helper_bitmap_init_from_buf^⚠
mtmd_helper_eval_chunk_single^⚠
mtmd_helper_eval_chunks^⚠
mtmd_helper_get_n_pos^⚠
mtmd_helper_get_n_tokens^⚠
mtmd_helper_image_get_decoder_pos^⚠
mtmd_helper_log_set^⚠
mtmd_init_from_file^⚠
mtmd_input_chunk_get_n_tokens^⚠
mtmd_input_chunk_get_tokens_image^⚠
mtmd_input_chunk_get_tokens_text^⚠
mtmd_input_chunk_get_type^⚠
mtmd_input_chunks_free^⚠
mtmd_input_chunks_get^⚠
mtmd_input_chunks_init^⚠
mtmd_input_chunks_size^⚠
mtmd_tokenize^⚠
native_runtime_loaded
runtime_abi_supported: Whether a native runtime reporting version can back this binary’s ABI bindings. Required symbol signatures and by-value struct layouts may change between patches, so the loader requires an exact ABI match.
skippy_abi_features: Returns the skippy ABI feature bitmask. Requires the native runtime to be loaded first (checked by caller).
skippy_abi_features_optional
skippy_apply_chat_template^⚠
skippy_apply_chat_template_json^⚠
skippy_backend_device_at^⚠
skippy_backend_device_count^⚠
skippy_decode_batch_sampled^⚠
skippy_decode_step_frame_batch_sampled^⚠
skippy_decode_step_frame_sampled^⚠
skippy_decode_step_frame_sampled_mtp^⚠
skippy_decode_step_sampled^⚠
skippy_decode_step_sampled_mtp^⚠
skippy_decode_step_sampled_mtp_fn
skippy_detokenize^⚠
skippy_error_free^⚠
skippy_export_full_state^⚠
skippy_export_kv_page^⚠
skippy_export_recurrent_state^⚠
skippy_export_state^⚠
skippy_import_full_state^⚠
skippy_import_kv_page^⚠
skippy_import_recurrent_state^⚠
skippy_import_state^⚠
skippy_model_attach_mtp_draft_model_fn
skippy_model_free^⚠
skippy_model_info_free^⚠
skippy_model_info_open^⚠
skippy_model_info_tensor_at^⚠
skippy_model_info_tensor_count^⚠
skippy_model_llama_model^⚠
skippy_model_open^⚠
skippy_model_open_from_parts^⚠
skippy_model_open_from_parts_with_events_fn
skippy_model_open_with_events_fn
skippy_ngram_cache_append^⚠
skippy_ngram_cache_create^⚠
skippy_ngram_cache_draft^⚠
skippy_ngram_cache_free^⚠
skippy_ngram_cache_reset^⚠
skippy_parse_chat_response_json^⚠
skippy_prefill_chunk^⚠
skippy_prefill_chunk_frame^⚠
skippy_prefill_chunk_frame_sampled^⚠
skippy_prefill_chunk_frame_sampled_with_positions^⚠
skippy_prefill_chunk_frame_with_positions^⚠
skippy_retire_verify_checkpoint^⚠
skippy_session_batch_size^⚠
skippy_session_begin_external_decode^⚠
skippy_session_configure_chat_sampling^⚠
skippy_session_copy_output_activation_frame^⚠
skippy_session_create^⚠
skippy_session_create_from_resident_prefix^⚠
skippy_session_drop_sequence^⚠
skippy_session_end_external_decode^⚠
skippy_session_free^⚠
skippy_session_last_token_signal^⚠
skippy_session_llama_context^⚠
skippy_session_position^⚠
skippy_session_reset^⚠
skippy_session_restore_prefix^⚠
skippy_session_sample_current^⚠
skippy_session_save_prefix^⚠
skippy_session_set_position^⚠
skippy_session_signal_window^⚠
skippy_slice_plan_add_layer_range^⚠
skippy_slice_plan_create^⚠
skippy_slice_plan_free^⚠
skippy_token_is_eog^⚠
skippy_tokenize^⚠
skippy_trim_session^⚠
skippy_verify_tokens^⚠
skippy_verify_tokens_frame_sampled^⚠
skippy_write_gguf_from_parts^⚠
skippy_write_slice_gguf^⚠
try_abi_features: Returns the Skippy ABI feature bitmask when the loaded dynamic runtime exports feature probing.

Type Aliases§

LlamaLogCallback
MtmdProgressCallback
Opaque
SkippyDecodeStepSampledMtpFn
SkippyModelAttachMtpDraftModelFn
SkippyRuntimeEventCallback

Unions§

LlamaModelKvOverrideValue

Crate skippy_ffi

Crate skippy_ffi Copy item path

Structs§

Enums§

Constants§

Functions§

Type Aliases§

Unions§

Crate skippy_ffi