pub struct OllamaGenerateResponse {
pub text: String,
pub context: Vec<i64>,
pub prompt_eval_count: u64,
pub eval_count: u64,
}Expand description
Full response from /api/generate, including KV cache context and token stats.
Used by OllamaClient::generate_with_full_response to support the two-step
KV cache pattern (prime with document, then enrich each chunk cheaply).
Fields§
§text: StringThe generated text
context: Vec<i64>KV cache token state — pass back as OllamaGenerationParams::context on the
next request to continue from this exact point without re-evaluating prior tokens.
prompt_eval_count: u64Tokens actually evaluated in the prompt (vs reused from KV cache). With KV cache working: ~= chunk_tokens. Without: ~= full_prompt_tokens.
eval_count: u64Tokens generated in the response.
Trait Implementations§
Source§impl Clone for OllamaGenerateResponse
impl Clone for OllamaGenerateResponse
Source§fn clone(&self) -> OllamaGenerateResponse
fn clone(&self) -> OllamaGenerateResponse
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for OllamaGenerateResponse
impl RefUnwindSafe for OllamaGenerateResponse
impl Send for OllamaGenerateResponse
impl Sync for OllamaGenerateResponse
impl Unpin for OllamaGenerateResponse
impl UnsafeUnpin for OllamaGenerateResponse
impl UnwindSafe for OllamaGenerateResponse
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more