+
L��i* � �� � R t ^ RIt^ RIt^ RIt^ RIt^ RItRtRtRt RRRRRR R
RRRR
RRR//RR.///RRRRRR RRRRR
RRR/RRR//RRR.///RRRRRR RRRRR
RRR//RR.///RRRRRR RRRRR
RRR/RRR//RR.///RRRRRR RRRRR
RRR//RR.///.t
RRRR/RRRR /RRRR!/.tRR"R#R$R%R&/RR'R#R(R%R)/RR*R#]R%R+/RR,R#]R%R+/RR-R#R.R%R//RR0R#]R%R/RR1R#]R%R/.tR8R2 R3 llt
R4 R5 ltR6 t]R78X d
]! 4 R# R# )9u
Test: prefix_kv_cache=1 — verify KV cache hit with stable system+tools prefix.
Sends 3 sequential requests with identical system+tools, appending one message
each turn. Measures TTFT and checks cached_tokens to verify prefix cache hit.
Usage:
python tests/test_prefix_kvcache.py
Nzhttp://macstudio.localz#https://api.gaterouter.ai/openai/v1z�You are a helpful AI assistant. You help users with coding, data analysis, and general questions.
Always respond concisely. Use Chinese when the user speaks Chinese.
Platform: macOS. Shell: bash/zsh.�type�function�name�execute_command�descriptionzRun a shell command�
parameters�object�
properties�command�string�required�
write_filezWrite content to a file�path�content� read_filezRead a file�memoryz Search or store long-term memory�action�query�
web_searchzSearch the web�role�useru'