Struct LarkBitableLlmCache 

pub struct LarkBitableLlmCache { /* private fields */ }

A team-shared LLM response cache stored in a Feishu Bitable table.

Each row represents one cached response, keyed by cache_key. Hit counts are tracked in a hit_count field and are visible directly in the Feishu spreadsheet, making cache utilisation observable without additional tooling.

Bitable table schema

Field name	Type	Notes
cache_key	Text	Unique cache key
response_json	Text	Serialised ChatResponse
hit_count	Text	Number of cache hits (string)
created_at	Text	Unix timestamp (seconds)

Implementations

impl LarkBitableLlmCache

pub fn new( config: LarkConfig, app_token: impl Into<String>, table_id: impl Into<String>, ) -> Self

Create a new cache backed by the given Bitable table.

pub fn app_token(&self) -> &str

Return the Bitable application token.

pub fn table_id(&self) -> &str

Return the Bitable table ID.

Trait Implementations

impl LlmCache for LarkBitableLlmCache

fn get<'life0, 'life1, 'async_trait>( &'life0 self, key: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<Option<ChatResponse>, SynapticError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Look up a cached response by cache key.

fn put<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, key: &'life1 str, response: &'life2 ChatResponse, ) -> Pin<Box<dyn Future<Output = Result<(), SynapticError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Store a response in the cache.

fn clear<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<(), SynapticError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Clear all entries from the cache.