Refactors Prompt Caching - #253

Merged

philipph-askui merged 10 commits into

mainfrom

feat/prompt_caching

Apr 1, 2026

Commits on Mar 25, 2026

fix usage tracker
mlikasam-askui
committed
34d65c3

Commits on Mar 30, 2026

feat: implement support for prompt caching (auto strategy) for anthropic provider
philipph-askui
committed
1f392b5
refactor(usage tracking): add cache read/write tokens to overwrite and cost calculation
philipph-askui
committed
d42b038
fix: remove errorneous pricing from askui_vlm_provider
philipph-askui
committed
e444973
fix: constrain grpc to <1.80.0
philipph-askui
committed
d7030dc
chore: remove usage tracker from Html report
philipph-askui
committed
7f8a759
fix: restore original cache control as it can be used complementary to new auto strategy
philipph-askui
committed
074f27e

Commits on Mar 31, 2026

fix broken `test_no_cost_when_pricing_none`
philipph-askui
committed
a53c551
fix: report formatting
philipph-askui
committed
567092d
fix: manual prompt caching breakpoints
philipph-askui
committed
aff286d