v1.3.5

Fixed

• Fixed trubrics run with new .json file corresponding to new Trubric data model

v1.3.4

Added

• Functionality to fail a Trubric run (cli or notebook) based on the severity of validations
• New integration with MlFlow 🎉 - you can now:
  • Validate an mlflow run with Trubrics with mlflow.evaluate(evaluators="trubrics")
  • Save all validation results to the MLflow UI
  • Write custom python functions to validate your data or models with MLflow

Changed

• Changed data model of Trubric object
• Tutorials for classification and regression models added to docs, ready to run in google colab
• Removed notebook run in the docs CI

v1.3.3

Fixed

• Users can now trubrics init with environment variables
• Clearer trubrics init documentation

v1.3.1.2

Fixed

• Users can now trubrics init without manual prompts

v1.3.2

Added

• New methods of FeedbackCollector to allow for the use of standalone Trubrics UI components. E.g. collector.st_faces_ui()
• Open question feedback option to collect with feedback types "issue" & "faces"
• Disable on click functionality for a smoother user experience with feedback types
• Feedback pydantic model returned from st_feedback() method

Changed

• Updated data model for the Feedback object
• Add a note to the demo app explaining the experiment features
• Changed order of feedback and validations in README
• Feedback components are now decoupled from the data context

v1.3.1

Added

• Custom type for streamlit FeedbackCollector
• Unit tests for streamlit FeedbackCollector
• Example code snippets for Demo app

v1.3.0

Added

• A brand new, shiny FeedbackCollector for streamlit 🎉. Highlights:
  • A new demo app on Titanic, with options for auth directly in the CLI
  • New FeedbackCollector object that stores metadata of your models and dataset versions
  • New auth component for Trubrics platform
  • New st_feedback() component with multiple types available
  • Updated docs

Fixed

• Flex dependencies versions
• Moved Streamlit, Gradio and Dash to extra_dependencies
• Moved feedback integrations to an integrations/ dir

v1.2.9

Fixed

• Display up to 50 projects from Trubrics in trubrics init
• Add @lru_cache to get Idtoken upon each write
• Hide locals in typer print (for sensitive password on error)

v1.2.8

Changed

• Refactored TrubricRun to include methods to generate a Trubric
• Update CLI docs and gifs

v1.2.7

Fixed

• Added .json to python package