Struct ChatViaResponsesFanout 

pub struct ChatViaResponsesFanout(/* private fields */);

Implementations

impl ChatViaResponsesFanout

pub async fn prepare<S: StateStore>( input: GenerateContentRequestBody, target: FanoutTarget, state: &GenerationStateAccess<'_, S>, ) -> Result<Self, TransformError>

pub async fn prepare_with_capabilities<S: StateStore, R: ResourceAccess>( input: GenerateContentRequestBody, target: FanoutTarget, state: &GenerationStateAccess<'_, S>, resources: &GenerationResources<'_, R>, ) -> Result<Self, TransformError>

Resources are read once before cloning the single-candidate request.

pub fn response_id(&self) -> &str

pub fn children(&self) -> &[ChatViaResponses]

pub async fn invoke<U: Upstream, S: StateStore>( &mut self, upstream: &U, target: &U::Target, limits: CodecLimits, state: &GenerationStateAccess<'_, S>, progress: &mut FanoutProgress<GenerateContentResponseBody>, facts: impl FnMut(usize, &GenerateContentResponseBody) -> Result<(), TransformError>, ) -> Result<Converted<GenerateContentResponseBody>, TransformError>

Sends each child at most once and aggregates their results in order.

impl ChatViaResponsesFanout

pub async fn prepare_stream<S: StateStore>( input: GenerateContentRequestBody, target: FanoutTarget, settings: StreamSettings, state: &GenerationStateAccess<'_, S>, ) -> Result<FanoutStream<ResponsesToChatStream>, TransformError>

pub async fn prepare_stream_with_capabilities<S: StateStore, R: ResourceAccess>( input: GenerateContentRequestBody, target: FanoutTarget, settings: StreamSettings, state: &GenerationStateAccess<'_, S>, resources: &GenerationResources<'_, R>, ) -> Result<FanoutStream<ResponsesToChatStream>, TransformError>

Trait Implementations

impl Debug for ChatViaResponsesFanout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.