Module linked 

The runtimes this build links, for source builds (--features basert, llamacpp, mlx).

Functions

check

The report a worker process of id would print, its runtime’s options counting from the first probe as they do in a worker’s prefix (Catalog::locate): the library they name, the cache types a model is sized with.

engine

feature_for

get

ids

report

runtimes

sizes_context

spawn

suggest_max_context

tokenizer