Skip to main content

Module thread_server

Module thread_server 

Source
Expand description

Thread-based server implementation

This module provides the server startup that uses thread-based shared memory architecture. All API handlers access state through Arc-wrapped shared memory (UnifiedAppState) — zero network hops between components. The only network call is to the localhost llama-server.

Structs§

ThreadBasedAppState
Thread-based unified application state (internal, used during initialization)

Functions§

run_thread_server
Run server with thread-based architecture