We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 59dd311 commit 964472bCopy full SHA for 964472b
docs/source/design/v1/metrics.md
@@ -415,8 +415,8 @@ The discussion in <gh-issue:10582> about adding prefix cache metrics yielded
415
some interesting points which may be relevant to how we approach
416
future metrics.
417
418
-Every time the prefix cache is queried, we record the number of blocks
419
-queried and the number of queried blocks present in the cache
+Every time the prefix cache is queried, we record the number of tokens
+queried and the number of queried tokens present in the cache
420
(i.e. hits).
421
422
However, the metric of interest is the hit rate - i.e. the number of
0 commit comments