pub struct EndpointInfo {
pub probing: bool,
pub server: String,
pub context_tokens: Option<u64>,
pub tools: ToolsMode,
pub vision: Option<bool>,
}Expand description
Capability summary of the inference endpoint, for a small header detail.
Fields§
§probing: boolThe probe is still running.
server: StringServer software, e.g. “llama.cpp”, “vLLM”, “Ollama”; empty if unknown.
context_tokens: Option<u64>Context window in tokens, if the server reports it.
tools: ToolsMode§vision: Option<bool>Takes image input: Some(true) yes, Some(false) no, None unknown.
Implementations§
Trait Implementations§
Source§impl Clone for EndpointInfo
impl Clone for EndpointInfo
Source§impl Debug for EndpointInfo
impl Debug for EndpointInfo
Source§impl Default for EndpointInfo
impl Default for EndpointInfo
Source§impl<'de> Deserialize<'de> for EndpointInfo
impl<'de> Deserialize<'de> for EndpointInfo
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for EndpointInfo
impl PartialEq for EndpointInfo
Source§impl Serialize for EndpointInfo
impl Serialize for EndpointInfo
impl StructuralPartialEq for EndpointInfo
Auto Trait Implementations§
impl Forget for EndpointInfo
impl Freeze for EndpointInfo
impl RefUnwindSafe for EndpointInfo
impl Send for EndpointInfo
impl Sync for EndpointInfo
impl Unpin for EndpointInfo
impl UnsafeUnpin for EndpointInfo
impl UnwindSafe for EndpointInfo
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more