Struct Daemon3 

pub struct Daemon3 { /* private fields */ }

Implementations

impl Daemon3

pub fn new(params: Daemon3Params) -> Self

pub fn with_port(hf_repo: String, port: u16, custom_args: Vec<String>) -> Self

👎Deprecated: Use Daemon3::new with Daemon3Params instead

Trait Implementations

impl Clone for Daemon3

fn clone(&self) -> Daemon3

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Daemon3

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<Daemon3Params> for Daemon3

fn from(params: Daemon3Params) -> Self

Converts to this type from the input type.

impl LlmDaemon for Daemon3

type Config = LlamaConfig

fn config(&self) -> &Self::Config

fn fork_daemon(&self) -> Result<()>

Spawns the daemon, initializing any necessary resources or processes. This method is expected to be called before creation of tokio runtime, mostly due to the use of the fork. User is free to use async runtime after calling this.

fn heartbeat<'a, 'b>(&'b self) -> impl Future<Output = Result<()>> + Send + 'a

where 'a: 'b,

Creates a task which maintains a periodic heartbeat to the daemon. Daemon is expected to terminate if there’s no heartbeat for a certain period of time. Keeping this task within async runtime will ensure that the daemon is kept running during the application. FIXME: Extract heartbeat / ready to Async util?

fn ping(&self) -> Result<()>

Send a single heartbeat to let daemon know there is a client. Can be useful if you don’t want to use heartbeat.

fn ready<'a>(&self) -> impl Future<Output = ()> + Send + 'a

FIXME: Extract heartbeat / ready to Async util?