pub struct TurnModels {
pub bridge: Arc<Bridge>,
pub provider: Arc<dyn StreamFn>,
pub resolve: ResolveModel,
pub api_key: ProviderKey,
pub root_session: Arc<OnceLock<String>>,
pub charge: Option<ChargeTurn>,
pub transform_child: Option<TransformChild>,
pub trace: Option<(Arc<RequestTrace>, String)>,
}Expand description
The provider as the durable generation calls it.
Fields§
§bridge: Arc<Bridge>§provider: Arc<dyn StreamFn>§resolve: ResolveModel§api_key: ProviderKeyThe key a request uses for its model’s provider (crate::request_keys), resolved per request: a root generation’s model is the one its checkpoint pinned, which a model switch during the turn does not change.
root_session: Arc<OnceLock<String>>The root conversation’s provider session ID: requests that carry it are the root’s turns; every other conversation is a subagent’s.
charge: Option<ChargeTurn>Charges every response of every conversation (the root’s, a subagent’s, a typed agent’s, another root conversation’s) to the usage ledger.
transform_child: Option<TransformChild>Changes a child conversation’s request before it is sent (transform_context: what ctx kept across a
compaction).
trace: Option<(Arc<RequestTrace>, String)>ULTRON_REQUEST_TRACE (crate::request_trace) and the session’s id: every answered request is traced.
Trait Implementations§
Source§impl Models for TurnModels
impl Models for TurnModels
fn get_model(&self, provider: &str, model_id: &str) -> Option<Model>
Source§fn stream(
&self,
model: &Model,
context: &TranscriptContext,
request: &StreamRequest,
signal: &Cancel,
on_event: &mut (dyn FnMut(&AssistantMessageEvent) + Send),
) -> Result<AssistantMessage>
fn stream( &self, model: &Model, context: &TranscriptContext, request: &StreamRequest, signal: &Cancel, on_event: &mut (dyn FnMut(&AssistantMessageEvent) + Send), ) -> Result<AssistantMessage>
Stream one response. Events go to
on_event as they arrive; provider failures are messages with stop reason
error; Err is a transport bug. An aborted signal ends the stream with an aborted message or Err.Source§fn fetch_deferred(
&self,
model: &Model,
handle: &DeferredHandle,
signal: &Cancel,
) -> Result<AssistantMessage, HarnessError>
fn fetch_deferred( &self, model: &Model, handle: &DeferredHandle, signal: &Cancel, ) -> Result<AssistantMessage, HarnessError>
Poll a deferred response; a still deferred result keeps stop reason
deferred.fn cancel_deferred( &self, model: &Model, handle: &DeferredHandle, signal: &Cancel, ) -> Result<(), HarnessError>
Auto Trait Implementations§
impl !RefUnwindSafe for TurnModels
impl !UnwindSafe for TurnModels
impl Forget for TurnModels
impl Freeze for TurnModels
impl Move for TurnModels
impl Send for TurnModels
impl Sync for TurnModels
impl Unpin for TurnModels
impl UnsafeUnpin for TurnModels
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more