roder-api-0.1.2
- roder-api 0.1.2
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- PandelisZ
- Dependencies
- anyhow ^1.0.102 normal
  async-trait ^0.1.89 normal
  futures ^0.3.32 normal
  semver ^1.0.28 normal
  serde ^1.0.228 normal
  serde_json ^1.0.149 normal
  time ^0.3.47 normal
  tokio ^1.52.3 normal
  toml ^1.1.2 dev
- Versions
- 4.19% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

cache_hit_rate

roder_api0.1.2

In roder_api::inference

roder_api::inference

Function cache_hit_rate

pub fn cache_hit_rate(
    prompt_tokens: u32,
    cached_prompt_tokens: u32,
) -> Option<f64>