Skip to content

Commit b1c1d5e

Browse files
trillvillebitsandfoxes
authored andcommitted
Update seer docs (#14027)
1 parent d33fafd commit b1c1d5e

File tree

8 files changed

+95
-40
lines changed

8 files changed

+95
-40
lines changed

docs/product/ai-in-sentry/index.mdx

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,6 @@ Seer is Sentry's AI debugging agent that helps resolve errors and performance is
1414

1515
- **[Issue Fix](/product/ai-in-sentry/seer/issue-fix/)**: Automated root cause analysis and suggested code fixes, for errors and performance issues.
1616
- **Issue Scan**: Scans issues as they are ingested in Sentry to determine an actionability score and run Seer's issue fix on them automatically.
17-
- **[Privacy & Security](/product/ai-in-sentry/ai-privacy-and-security/)**: Understanding how Seer handles your data securely.
1817

1918
## Issue Summary
2019

Loading
Loading
318 KB
Loading
Loading
Loading

docs/product/ai-in-sentry/seer/index.mdx

Lines changed: 29 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -4,39 +4,49 @@ description: "Learn about Seer, Sentry's AI agent, and managing generative AI fe
44
sidebar_order: 21
55
---
66

7-
Seer is Sentry's AI debugging agent. It includes a set of features, built on generative AI, that use Sentry's rich context (issue details, tracing data, logs, and profiles) to help you troubleshoot and fix errors and performance issues faster.
7+
Seer is Sentry's AI debugging agent. It uses Sentry's rich context (issue details, tracing data, logs, and profiles) to help you troubleshoot and fix errors and performance issues faster.
88

99
## Seer Capabilities
1010

11-
Seer provides two main capabilities to enhance your debugging:
11+
Seer provides three main capabilities to enhance your debugging:
1212

13-
- [**Issue fix**](#issue-fix): A collaborative workflow to find the root cause and solution of errors and performance issues.
14-
- **Issue scan**: Intelligently analyzes your issues and provides actionability scores to help you prioritize what to work on.
13+
- [**Issue fix**](#issue-fix): A collaborative agent skilled at root cause analysis and solving issues
14+
- [**Issue scan**](#issue-scan): Automatically scans issues as they come in, feeding additional context to your alerts and automating triage
15+
- [**Automation**](#automation): Combines issue fix and scan into a powerful workflow: identifying actionable issues in real time and generating high quality fixes, automatically
1516

1617
### Issue Fix
1718

18-
Issue fix uses AI to find the root cause of your apps' issues and suggest solutions. With issue fix, you can:
19+
Seer combines all of the relevant context from your code with Sentry's telemetry data to provide a best-in-class issue debugging experience. The workflow consists of three steps:
1920

20-
- Get an accurate root cause analysis, using Sentry's context and your codebases
21-
- Receive suggested code fixes and unit tests
22-
- Collaborate with Seer throughout the debugging process
23-
- Create pull requests directly from the Seer interface
21+
1. Root cause the issue using Sentry's context and your codebase
22+
2. Identify a solution based on the analysis
23+
3. Generate a code patch that implements the solution and open a PR
2424

25-
Learn more about [issue fix](./issue-fix/).
25+
For a full product walk-through, see [issue fix](./issue-fix/).
26+
27+
<VimeoEmbed id="1091964967?h=4f24769ccd" />
2628

2729
### Issue Scan
2830

29-
Issue scan intelligently analyzes your issues and helps you prioritize what to work on. With issue scan, you can:
31+
Seer is able to automatically analyze issues as they are ingested by Sentry. This initial review is used to:
32+
33+
- Generate an "actionability" score, which indicates how likely it is that a particular issue can be fixed with a code change
34+
- Augment issue alerts with a helpful analysis about the problem
35+
- Add an initial guess for what the potential problem is to the issue details page
36+
37+
The actionability score is represented in the issue feed by a Seer icon, which indicate issues that are likely straightforward fixes.
38+
39+
### Automation
40+
41+
You can use automation to trigger issue scans and fixes. There are three automation settings you can configure:
3042

31-
- View actionability scores that indicate how likely an issue is to be fixable with a code change, manually or with Seer's issue fix
32-
- Enable Seer's issue fix to be started automatically once an issue is ingested in Sentry
33-
- Filter issues by their latest scan results
34-
- See Seer labels in the issue stream for quick identification
35-
- Get insights into which issues need immediate attention
43+
1. **Automate Issue Scans**: This enables Seer's issue scan functionality
44+
2. **Automate Issue Fixes**: This allows you to customize the degree of automation employed by Seer. For example, setting it to "Highly Actionable and Above" will automatically trigger issue fixes for all of your highly actionable Issues.
45+
3. **Stopping Point for Automatic Fixes**: Seer allows you to customize how far to go with automation. By default, it stops at the solution step, but you can choose to have it go all the way to code changes or even generate PRs automatically.
3646

37-
## How Seer Works
47+
## What Seer Uses
3848

39-
Seer leverages multiple data sources to provide accurate analysis and solutions:
49+
Seer is a powerful debugging agent, with access to a wide variety of data sources and tools. While debugging issues, it may examine:
4050

4151
- **Issue Context**: Error messages, stack traces, and event metadata from your [Issues](/product/issues/)
4252
- **Tracing Data**: Distributed [traces](/concepts/key-terms/tracing/#whats-a-trace) and span information
@@ -50,7 +60,7 @@ Seer leverages multiple data sources to provide accurate analysis and solutions:
5060
To start using Seer's capabilities:
5161

5262
1. **Enable Seer**: Make sure AI features are enabled in your [organization settings](https://sentry.io/orgredirect/organizations/:orgslug/settings/#hideAiFeatures)
53-
2. **Set up GitHub Integration**: For issue fix capabilities, [connect your GitHub repositories](/organization/integrations/source-code-mgmt/github/)
63+
2. **Set up GitHub Integration**: For Seer to be able to create patches and open pull requests, [connect your GitHub repositories](/organization/integrations/source-code-mgmt/github/)
5464
3. **Configure Settings**: Customize Seer's behavior in your project settings
5565
4. **Start Using**: Look for Seer options in your issue details pages
5666

Lines changed: 66 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -1,46 +1,92 @@
11
---
22
title: Issue Fix
3-
description: "Use Seer's Issue Fix to automatically find the root cause of issues and generate code fixes."
3+
description: "Use Seer's issue fix to automatically find the root cause of issues and generate code fixes."
44
sidebar_order: 20
55
---
66

7-
**Issue Fix** is Seer's collaborative workflow to find the root cause of and solution to issues. It uses Sentry's context (issue details, tracing data, logs, and profiles), your codebases (integrated through GitHub), and its interactions with you to identify and reason through problems in your code.
7+
**Issue fix** is Seer's collaborative workflow to find the root cause of and solution to issues. It uses Sentry's context (issue details, tracing data, logs, and profiles), your codebases (integrated through GitHub), and its interactions with you to identify and reason through problems in your code.
8+
9+
Issue fix can be automated, allowing it to populate root cause analysis, solutions, and even pull requests as issues occur.
810

911
<Alert>
10-
Issue Fix replace Suggested Fix (an earlier feature that has been sunset) and builds upon the capabilities previously known as Autofix.
12+
Issue fix builds upon the capabilities previously known as Autofix.
1113
</Alert>
1214

1315
## How Issue Fix Works
1416

15-
When you start an Issue Fix run, you'll see the following screen, with an option to share any additional context:
17+
Seer's issue fix flow follows a three step process:
18+
19+
1. [Root Cause Analysis](#root-cause-analysis): Analyze the issue using Sentry's context and your codebases and determine the root cause
20+
2. [Solution Identification](#solution-identification): Identify a solution based on the analysis
21+
3. [Code Generation](#code-generation): Generate a code fix and open a PR
22+
23+
When you begin debugging an issue with Seer, you will see a screen like this, which includes the high-level issue summary and a button to start the issue fix flow:
24+
25+
![Issue Fix Start Screen](../img/issue-fix-start-screen.png)
26+
27+
### Root Cause Analysis
28+
29+
Seer will then analyze the issue and relevant code to help identify the root cause and propose a solution. You'll see a live stream of Seer's thought process in real time as it works through the problem. Seer will share key insights as they come up and you'll have the option to expand each. You'll see the event data and code that support Seer's conclusions, building a clear chain of reasoning back to the root cause.
30+
31+
While Seer is reasoning through your problem, you can step in to add context or feedback; collaboration tends to lead to the best results. If Seer encounters gaps in its understanding, it will ask for your input.
32+
33+
The final root cause analysis will show you the sequence of events that led to the issue, and a detailed analysis of the most likely culprit. This analysis includes helpful annotations, such as links back to the exact lines of code or Sentry telemetry that are relevant to the analysis.
34+
35+
![Screenshot of the root cause analysis completed by Seer](../img/rca.png)
36+
37+
### Solution Identification
1638

17-
{/* IMG */}
39+
Once Seer has completed its root cause analysis, it will begin searching for a solution. The process will be familiar: you will see a chain of reasoning appear as it begins working through the problem, and you are free to collaborate with Seer at any point.
1840

19-
Issue Fix will then analyze the issue and relevant code to help identify the root cause and a solution. You'll see a live stream of Seer's thought process in real time as it works through the problem. Seer will share key insights as they come up and you'll have the option to expand each. You'll see the event data and code that support Seer's conclusions, building a clear chain of reasoning back to the root cause.
41+
When it's finished, you will see the recommended solution. From here, you can:
2042

21-
While Issue Fix is reasoning through your problem, you can step in to add context or feedback; collaboration tends to lead to the best results. If Issue Fix encounters gaps in its understanding, it will ask for your input.
43+
1. Remove any steps or actions that you disagree with
44+
2. Add any additional steps or instructions, for example request additional unit tests to prevent regressions of the original error
2245

23-
The output will be a clearly defined root cause of the Sentry issue, and a detailed solution for how to resolve it:
46+
Once you are ready to proceed, you can select "Code It Up" to generate code resolving the bug.
2447

25-
{/* IMG */}
48+
### Code Generation
2649

27-
You are free to edit or adjust this solution based on your own requirements and preferences. Once you are ready to proceed, you can select "Code It Up" to generate code resolving the bug. From there you'll have three options:
50+
During the coding step, Seer will identify the code patch(or patches) needed to implement the solution. When it's done, you'll see a preview showing the suggested diffs across your codebase. If the fix involves service dependencies, you may see edits spanning across multiple repositories.
2851

29-
- Write a fix
30-
- Write a unit test reproducing the issue
31-
- Write both
52+
From here, you can choose to draft a PR, or checkout the code changes locally for further iteration. If you choose to checkout the code locally, Seer will make a new branch for you.
3253

33-
{/* IMG */}
54+
![Screenshot of Seer showing code it generated](../img/coding-step.png)
3455

35-
Once the coding step is complete, you can either create a Pull Request (PR) in GitHub directly from Seer, or create a branch and checkout the code locally if you would like to iterate further.
56+
## What Issue Fix Uses
3657

37-
## Prerequisites
58+
Seer is a powerful debugging agent, with access to a wide variety of data sources and tools. While debugging issues, it may examine:
3859

39-
To use Issue Fix, you'll need to have the following:
60+
- **Issue details**: Error messages, stack traces, and event metadata from your [Issues](/product/issues/)
61+
- **Tracing data**: Distributed [traces](/concepts/key-terms/tracing/#whats-a-trace) and span information
62+
- **Logs**: Structured [Logs](/product/explore/logs/) from your application (beta)
63+
- **Your codebases**: Relevant code from linked GitHub repositories, with support for multiple repos for distributed services
64+
- **Performance data**: Profiles and performance metrics
65+
- **Interactive feedback**: Your input and guidance during the process
4066

41-
1. A Sentry project with issues that have sufficient context (issue details, tracing data, logs, and profiles).
67+
This context is crucial to Seer's capabilities, and it allows it to do things like investigate a backend service that may be the true root cause for a frontend bug you are trying to troubleshoot.
4268

43-
2. GitHub integration set up in your Sentry project. This allows Seer to access your codebase and generate code fixes. See the [Sentry GitHub integration](/organization/integrations/source-code-mgmt/github/) to learn more.
69+
## Settings
4470

45-
3. Working knowledge of the issue you want to fix. Seer will help you identify the root cause and suggest a solution, but you should have a general understanding of the problem you're trying to solve.
71+
Issue fix's default behavior can be customized in several ways:
72+
73+
1. You can manually customize the repositories it has access to
74+
2. You can define the default branch it should use in each repository
75+
3. You can add any additional custom context that that may be useful within the scope of each individual repository
76+
77+
<Alert>
78+
Seer already automatically parses rules files from [Cursor](https://docs.cursor.com/context/rules), [Windsurf](https://windsurf.com/editor/directory), [Cline](https://docs.cline.bot/features/cline-rules), and [Claude Code](https://docs.anthropic.com/en/docs/claude-code/tutorials#create-an-effective-claude-md-file)
79+
</Alert>
80+
81+
![Screenshot of the repository settings page](../img/repo-settings.png)
82+
83+
## Best Practices
84+
85+
- Setup the GitHub integration, allowing Seer access to your codebase and enabling it to generate code fixes. Enabling the GitHub integration will help Seer to provide better results. See the [Sentry GitHub integration](/organization/integrations/source-code-mgmt/github/) to learn how
86+
- The more Sentry context you have, the better equipped Seer will be to help: consider instrumenting your application to collect traces, profiles and logs, and send them to Sentry.
87+
- For JavaScript / TypeScript projects that are minified in production, upload [source maps](/platforms/javascript/sourcemaps/) to Sentry for the best results
88+
89+
<Alert>
90+
Currently, GitHub is the only SCM supported by Seer. We are currently working to add support for other services including GitLab and Bitbucket.
91+
</Alert>
4692

0 commit comments

Comments
 (0)