[Help needed] Anthropic Caching filter: Can filter only access user/assistant messages and not system ? #292
Unanswered
thiswillbeyourgithub
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
I was trying to make a simple filter (NOT using pipelines, I want to make it simple for others to install) that automatically modifies the system message to use caching for anthropic models. But after coding a draft it appears that the
body
myinlet
receives only contains user and assistant messages, but no system prompts.Is that a bug or on purpose? I have to say it's surprising to me that an inlet filter would only access the user/assistant message and not all chat messages at it severely reduces its potential applications to my eyes.
Here's my draft if you want to take a look: https://github.com/thiswillbeyourgithub/openwebui_custom_pipes_filters/blob/main/filters/WIP_automatic_claude_caching.py
Beta Was this translation helpful? Give feedback.
All reactions