How to efficiently create, maintain, and filter examples in Langsmith's dataset #14698
MillionWang0724
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
During use, it was found that the management tool for examples is not very user-friendly. Here are some issues that need to be addressed:
Adding and updating test cases is troublesome. When the test set is first created, it is allowed to upload CSV test case files in bulk. After creation, adding new test cases requires manual addition of individual cases
The interaction interface of use case management is not ideal, and there are certain difficulties in querying, locating, and filtering use cases, which can only be searched page by page, resulting in a poor experience
Langsmith only has input and output columns for the parameters of the test data, but in reality, input contains a lot of content. When there are many fields that need to be maintained, the observation of test cases is not intuitive, and creating them is also quite cumbersome.
When a common field in the set of use cases is updated in bulk, updating it on Langsmith is very cumbersome. It requires finding some use cases at once, finding the corresponding fields, and modifying them one by one, which may easily lead to omissions.
Beta Was this translation helpful? Give feedback.
All reactions