-
Notifications
You must be signed in to change notification settings - Fork 16
Allow filters to be defined when calling VS tool #104
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update default description Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Signed-off-by: Ann Zhang <ann.zhang@databricks.com> keep import Signed-off-by: Ann Zhang <ann.zhang@databricks.com> ruff Signed-off-by: Ann Zhang <ann.zhang@databricks.com> add dependency Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Signed-off-by: Ann Zhang <ann.zhang@databricks.com> fix Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> make required Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Signed-off-by: Ann Zhang <ann.zhang@databricks.com> update openai tests Signed-off-by: Ann Zhang <ann.zhang@databricks.com> format Signed-off-by: Ann Zhang <ann.zhang@databricks.com> else case Signed-off-by: Ann Zhang <ann.zhang@databricks.com> lint Signed-off-by: Ann Zhang <ann.zhang@databricks.com> improve unit tests Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
'- Pattern match: {"column LIKE": "word"} (matches full tokens separated by whitespace)\n' | ||
'- OR logic: {"column1 OR column2": [value1, value2]} ' | ||
"(matches if column1 equals value1 or column2 equals value2; matches are position-specific)" | ||
), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit can also include this link if you think it will be useful: https://docs.databricks.com/aws/en/generative-ai/create-query-vector-search?language=Python%C2%A0SDK#use-filters-on-queries
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nvm didnt realize llm is getting passed this. So a link wont be useful
if not name.startswith("__"): | ||
columns.append((name, col_type, comment)) | ||
|
||
return "The vector search index includes the following columns:\n" + "\n".join( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is pretty cool
Signed-off-by: Ann Zhang <ann.zhang@databricks.com>
Description of changes
filters
through when invoking VS tool, and combine with filters defined at initialization time.How is this tested?
Langchain

OpenAI

LlamaIndex
