generated from mintlify/starter
-
Notifications
You must be signed in to change notification settings - Fork 8
Add Product use case #290
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
tothmano
wants to merge
11
commits into
main
Choose a base branch
from
mano/ai-product-use-cases
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Add Product use case #290
Changes from 2 commits
Commits
Show all changes
11 commits
Select commit
Hold shift + click to select a range
6af7056
Add AI and Product use cases
tothmano 14ecfe0
Update ai-machine-learning.mdx
tothmano 97b8511
First fixes
tothmano b273fd1
Merge branch 'main' into mano/ai-product-use-cases
tothmano a4006f0
Update learn-about-axiom.mdx
tothmano 2857167
Merge branch 'main' into mano/ai-product-use-cases
tothmano ecbfc75
Address feedback
tothmano a9ee4ff
Implement feedback
tothmano 96152e4
Merge branch 'main' into mano/ai-product-use-cases
tothmano 140049c
Update product-analytics.mdx
tothmano 074c797
Merge branch 'mano/ai-product-use-cases' of https://github.com/axiomh…
tothmano File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,54 @@ | ||
--- | ||
title: "Axiom for AI and machine learning" | ||
description: "This page explains how Axiom helps you leverage timestamped event data for AI and machine learning purposes." | ||
sidebarTitle: AI and ML | ||
--- | ||
|
||
Axiom allows you to monitor, evaluate, and iterate on AI models in production. | ||
|
||
As machine learning (ML) becomes central to user-facing applications, the challenge is no longer just building and deploying models, but improving them in production. | ||
|
||
Axiom enables ML and product engineering teams to continuously monitor and improve AI models in production by closing the loop between real-world data, model behavior, and iteration workflows. We integrate with your existing ML stack, such as Databricks, SageMaker, or Modal to surface failures, detect drift, and validate improvements without adding unnecessary complexity. | ||
|
||
## Why event data matters in AI and machine learning | ||
|
||
Shipping an AI model is only the beginning. The real challenge starts when it’s live and interacting with real users. Issues like hallucinations, bias, or degraded accuracy can damage user trust or experience. While many teams can detect that a model failed, very few can easily isolate the root cause, test a fix using production data, and confidently re-ship without days of manual effort. | ||
|
||
## Key features of Axiom for AI and machine learning | ||
|
||
With Axiom, you can solve the issues mentioned above: | ||
|
||
- **Capture and replay real-world inference data:** Automatically sample or flag production inputs and outputs to create test scenarios based on actual usage, not synthetic data. | ||
- **Compare model versions at scale:** Run side-by-side tests between current and proposed model versions using real production slices. Visualize regressions, improvements, and unintended changes. | ||
- **Orchestrate model updates confidently:** Integrate with your model orchestrator to re-deploy tested improvements with a few clicks, without pipeline rewrites required. | ||
- **Shorten iteration cycles:** Reduce iteration time from days to hours by eliminating manual steps like downloading logs, writing scripts, or rebuilding test cases. | ||
|
||
## Important use cases | ||
|
||
| Role | Problem | What Axiom offers | | ||
|--------------------|------------------------------------------------------------------------|-------------------------------------------------------------------------| | ||
| ML engineers | Debugging and testing are slow and manual | Automate capture and replay of inference data for quick validation | | ||
| Applied AI teams | Hard to measure impact of model changes in production | Run version comparisons with real production examples | | ||
| Product engineers | Limited visibility into model behavior post-deployment | See and test how real users are affected in production | | ||
|
||
## How Axiom works for AI and machine learning | ||
|
||
Axiom introduces a closed-loop workflow that integrates with your current ML infrastructure: | ||
|
||
1. **Detect:** Automatically surface anomalous, drifting, or low-confidence outputs in production. | ||
1. **Sample:** Capture relevant inputs and outputs to build test cases from real-world examples. | ||
1. **Validate:** Run tests against current and new model versions. Inspect where improvements or regressions occur. | ||
1. **Ship:** Re-deploy the improved model confidently using built-in orchestration tools. | ||
|
||
This process lets you maintain a rapid feedback loop between observe, refine, re-ship. | ||
|
||
## Why choose Axiom for AI and machine learning | ||
|
||
Axiom is perfect for iteration on live usage data. It fits naturally into modern stacks without forcing major changes. | ||
|
||
You’ll benefit most if you: | ||
|
||
- Already have models in production. | ||
- Discover issues late via user complaints or delayed log review. | ||
- Manually gather logs and write ad hoc scripts to test model fixes. | ||
- Want to tighten the iteration loop for faster, more confident updates. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
--- | ||
title: "Axiom for product analytics" | ||
description: "This page explains how Axiom helps you leverage timestamped event data for product analytics purposes." | ||
sidebarTitle: Product analytics | ||
--- | ||
|
||
Axiom helps you leverage the power of timestamped event data. Axiom believes that event data reflects a broad range of interactions, crossing boundaries from engineering to product management, security, and beyond. For a more general explanation of event data in Axiom, see [Events](/getting-started-guide/event-data). | ||
tothmano marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
This page explains how you can leverage the power of event data for the product analytics use case. | ||
|
||
In product analytics, the ability to harness and interpret data effectively can determine the success of a product. Axiom offers a new approach to product analytics by leveraging the power of timestamped event data. This unique capability enables organizations to gain actionable insights, optimize user experiences, and drive product innovation. | ||
tothmano marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
## Why event data matters in product analytics | ||
|
||
Event data captures the actions and interactions users have with a product over time. From button clicks and page views to error events and feature usage, every timestamped event tells a story about user behavior. Axiom’s platform is specifically designed to process and analyze these granular datasets, making it an indispensable tool for product teams aiming to do the following: | ||
|
||
- **Understand user behavior:** By tracking and analyzing event streams, Axiom provides a clear picture of how users engage with your product. | ||
- **Identify trends and patterns:** Time-series analysis reveals emerging trends, helping teams anticipate user needs and adjust strategies proactively. | ||
- **Optimize product features:** Pinpoint which features drive the most value and identify friction points that need improvement. | ||
|
||
## Key features of Axiom for product analytics | ||
|
||
The following key features make Axiom perfect for product analytics: | ||
|
||
- **Real-time event monitoring:** Axiom’s ability to ingest and process data in real-time means you can monitor user activity as it happens. This empowers product managers to act quickly in response to anomalies or unexpected usage patterns, reducing downtime and improving user satisfaction. | ||
tothmano marked this conversation as resolved.
Show resolved
Hide resolved
|
||
- **Unified data platform:** Axiom eliminates data silos by integrating event data from diverse sources into a single, cohesive platform. Whether your data originates from web applications, mobile apps, or third-party tools, Axiom ensures seamless access and analysis. | ||
tothmano marked this conversation as resolved.
Show resolved
Hide resolved
|
||
- **Advanced query capabilities:** With a robust query language, Axiom enables product teams to dive deep into data analysis. Perform detailed segmentation, drill down into specific user journeys, and uncover insights that would otherwise remain hidden. | ||
- **Custom dashboards and visualizations:** Intuitive dashboards and customizable visualizations make it easy for product managers to communicate insights to stakeholders. Axiom’s visual tools enhance collaboration and decision-making. | ||
- **Scalable infrastructure:** As your product grows, so does the volume of event data. Axiom’s architecture is built to scale effortlessly, ensuring that your analytics remain robust and reliable, even with massive datasets. | ||
|
||
## Enhance product analytics with Axiom | ||
tothmano marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
Axiom helps you make the most of your event data in the following product analytics use cases, among others: | ||
|
||
- **Feature adoption analysis:** Understand how new features are adopted by users and identify which aspects require improvement to maximize engagement. | ||
- **Retention and churn analysis:** Leverage event data to identify patterns in user retention and predict potential churn, enabling proactive interventions. | ||
- **Funnel optimization:** Analyze user journeys through critical funnels, such as sign-ups or purchases, to pinpoint drop-off points and optimize conversion rates. | ||
- **A/B testing:** Compare user interactions across different test groups to validate hypotheses and make data-driven decisions. | ||
|
||
## Why choose Axiom for product analytics | ||
|
||
Axiom’s focus on timestamped event data makes it perfect for product analytics. By crossing boundaries from engineering to product management and security, Axiom empowers cross-functional teams to collaborate effectively. Its comprehensive feature set ensures that organizations can unlock the full potential of their data, driving smarter decisions and fostering innovation. | ||
|
||
In competitive markets, understanding your users is paramount. With Axiom, you gain a trusted partner in turning event data into actionable insights that propel your product to new heights. Experience the future of product analytics with Axiom and transform how you build, analyze, and optimize your product. |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.