Skip to content

DOCS-26 - Metrics DPM - GA #3058

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 32 commits into from
Jun 28, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
f5899f5
Add release note
jpipkin1 Sep 11, 2023
1e9da8e
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Oct 17, 2023
8789dcf
Update blog-service/2023-10-27-metrics.md
jpipkin1 Oct 17, 2023
55e4b9c
Change release note date
jpipkin1 Nov 30, 2023
47d417a
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Jan 12, 2024
99f5a07
Change date of release note
jpipkin1 Jan 30, 2024
c68c5ec
Update path and image
jpipkin1 Jan 30, 2024
2f7687d
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Jan 31, 2024
0ac6971
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Mar 20, 2024
d7434af
Merge branch 'main' into metrics-dpm-ga
kimsauce Mar 20, 2024
58d251d
Update to latest version on EpdData
jpipkin1 Apr 1, 2024
d7a6949
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Apr 2, 2024
eac5bbb
Update release note
jpipkin1 Apr 2, 2024
bb776fe
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Apr 11, 2024
192a468
Minor update
jpipkin1 Apr 16, 2024
0a2696a
Change release note date to April 25 2024
jpipkin1 Apr 17, 2024
0713dd5
Add text about data lag
jpipkin1 Apr 25, 2024
90d8240
Minor fix
jpipkin1 Apr 26, 2024
9dc2b1b
Change date on release note to May 3 2024
jpipkin1 Apr 30, 2024
3ce2640
Merge branch 'main' into metrics-dpm-ga
jpipkin1 May 13, 2024
4013478
Add note about index retention period
jpipkin1 May 13, 2024
a2fa3f7
Add Kanso instructions
jpipkin1 May 17, 2024
d240338
Merge branch 'main' into metrics-dpm-ga
jpipkin1 May 17, 2024
2f57b13
Changed release note date to May 30 2024
jpipkin1 May 28, 2024
dd0a2d8
Change release note date to June 21 2024
jpipkin1 May 30, 2024
6eebee8
Update screenshot
jpipkin1 Jun 13, 2024
b6e70c3
Merge branch 'main' into metrics-dpm-ga
jpipkin1 Jun 20, 2024
01cfc45
Change release note date to June 24 2024
jpipkin1 Jun 20, 2024
ef9f7ce
Merge branch 'main' into metrics-dpm-ga
kimsauce Jun 28, 2024
b56a960
Merge branch 'main' into metrics-dpm-ga
kimsauce Jun 28, 2024
3e7502a
Update and rename 2024-06-24-metrics.md to 2024-06-28-metrics.md
kimsauce Jun 28, 2024
1555368
Merge branch 'main' into metrics-dpm-ga
kimsauce Jun 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions blog-service/2024-06-28-metrics.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
---
title: Metrics Data Ingestion (Metrics)
image: https://www.sumologic.com/img/logo.svg
keywords:
- metrics
- volume
- dpm
hide_table_of_contents: true
authors:
- url: https://help.sumologic.com/release-notes-service/rss.xml
image_url: /img/release-notes/rss-orange.png
---

We're excited to announce the release of Metrics Data Ingestion, a new screen that provides detailed information about your metrics data consumption.

Metrics Data Ingestion answers the question, “What things are sending metrics data, and how much are they sending?”. This screen not only provides high level information about the metrics volume, you'll also see a breakdown by individual metric, as well as specific dimensions and sources. With this information, you can determine the items that contribute most to your credit consumption.

To access the new screen, navigate to **Administration > Account > Metrics Data Ingestion**.

[Learn More](/docs/metrics/metrics-dpm)
10 changes: 5 additions & 5 deletions docs/metrics/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,20 +56,20 @@ Metrics are an effective tool for monitoring, troubleshooting, and identifying t
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/metrics/logs-to-metrics"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Logs to Metrics</h4></a>
<a href="/docs/metrics/logs-to-metrics"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Logs-to-Metrics</h4></a>
<p>Set up rules to extract or create metrics from log data.</p>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/metrics/kubernetes-metrics"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Kubernetes Metrics</h4></a>
<p>Kubernetes metrics are collected when you deploy our Kubernetes collection.</p>
<a href="/docs/metrics/metrics-dpm"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Metrics Data Ingestion</h4></a>
<p>View detailed information about your metrics data consumption.</p>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/metrics/metric-charts"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Metrics Charts</h4></a>
<p>Visualize metrics data in Sumo Logic.</p>
<a href="/docs/metrics/kubernetes-metrics"><img src={useBaseUrl('img/icons/metrics.png')} alt="icon" width="40"/><h4>Kubernetes Metrics</h4></a>
<p>Kubernetes metrics are collected when you deploy our Kubernetes collection.</p>
</div>
</div>
</div>
Expand Down
19 changes: 7 additions & 12 deletions docs/metrics/metrics-dpm.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,15 +5,9 @@ sidebar_label: Metrics Data Ingestion
description: Metrics Data Ingestion allows you to view metrics ingest volumes across your teams and services to find which sources are sending metrics data.
---

<head>
<meta name="robots" content="noindex" />
</head>

<p><a href="/docs/beta"><span className="beta">Beta</span></a></p>

import useBaseUrl from '@docusaurus/useBaseUrl';

You can view your metrics data ingestion volume by navigating to **Administration > Account > Metrics Data Ingestion**. The screen provides a granular breakdown of your metrics ingestion and credits used. You can track consumption by individual metric names, or by specific dimensions and sources. With this data, you can see which sources and metrics contribute most to your credit consumption, and take necessary action. 
You can view your metrics data ingestion volume on the **Metrics Data Ingestion** page. This page provides a granular breakdown of your metrics ingestion and credits used. You can track consumption by individual metric names, or by specific dimensions and sources. With this data, you can see which sources and metrics contribute most to your credit consumption, and take necessary action. 

Understanding the volume of metrics that you are ingesting is important because when you exceed the credit limit, data is cached on the host and the source is throttled, reducing query performance and accuracy. For more information, see [Data Limits for Metrics](/docs/metrics/manage-metric-volume/data-limits-for-metrics/).

Expand All @@ -22,23 +16,24 @@ Data volume for metrics is often measured in data points per minute (DPM). A dat
While you can also see metrics ingestion breakdown in the [**Metrics** dashboard](/docs/integrations/sumo-apps/data-volume/#metrics) of the Data Volume app, the dashboard only shows volume usage at a source category or source host level. Use the Metrics Data Ingestion screen to get more detailed information.

:::note
To see data volume, you'll need to enable [Audit Index](/docs/manage/security/audit-indexes/audit-index).
* To see data volume, you'll need to enable [Audit Index](/docs/manage/security/audit-indexes/audit-index).
* How far back in time you can view data is determined by your organization’s retention period for Audit Index. For more information, see [Index Retention Period](/docs/manage/security/audit-indexes/audit-index/#index-retention-period).
:::

## View Metrics Data Ingestion

Navigate to **Administration > Account > Metrics Data Ingestion**.
<!--Kanso [**Classic UI**](/docs/get-started/sumo-logic-ui/). Kanso--> To access the Metrics Data Ingestion page, in the main Sumo Logic menu select **Administration > Account > Metrics Data Ingestion**. <!--Kanso <br/>[**New UI**](/docs/get-started/sumo-logic-ui-new/). To access the Metrics Data Ingestion page, in the Sumo Logic top menu select **Administration**, and then under **Account** select **Metrics Data Ingestion**. You can also click the **Go To...** menu at the top of the screen and select **Metrics Data Ingestion**. Kanso-->

 <img src={useBaseUrl('img/metrics/metrics-dpm.png')} alt="Metrics Data Ingestion screen" style={{border: '1px solid gray'}} width="800" />

1. **Date and time**. Select a time to see the metrics gathered for the previous hour.
1. **Ingest Trend for** `<date>`. The trend for ingest for the current day, broken down by hour.
1. **Ingest Trend for** `<date>`. The trend for ingest for the current day, broken down by hour. If you hover your mouse over a gray bar, it displays **Ingest data for this period is not available yet** to indicate that data has not been collected and analyzed yet for that time period. There can be a delay of several hours before data is available.
1. **Metric**. Select a specific metric to view its ingest breakdown. Leave blank if you want to view breakdown for all metrics.
1. **Filter**. Select the dimensions for which you want to view ingest breakdown. Leave blank if you want to view all dimensions. (You cannot use the filter if you selected a specific metric in the **Metric** field.)
1. **Total Ingest Data Points (1 hr)**. The total number of data points ingested during the previous hour. The green up arrow indicates the total is higher than the previous hour, and a red down arrow indicates the total is lower than the previous hour. This lets you see at a glance whether volume rates are rising or falling.
1. **Ingest DPM (1 hr)**. The data points per minute (DPM) ingested during the previous hour.
1. **Ingest DPM (yesterday)**. The average number of data points per minute (DPM) ingested during the previous day.
1. **Total Ingest Data Points (yesterday)**. The total number of data points ingested during the previous day.
1. **Ingest DPM (yesterday)**. The average number of data points per minute (DPM) ingested during the previous 24 hours.
1. **Total Ingest Data Points (yesterday)**. The total number of data points ingested during the previous 24 hours.
1. **Historical Trend**. The ingest trends over the last day or week.
1. **Top 100 Data Points/min by Metric**. The top metrics that have the highest data points ingested. Click a specific metric on the diagram to see a breakdown of ingest for that metric.  
1. **Top 100 Data Points/min by Dimension**. The top data points per minute by dimension. Click a dimension on the diagram to see a breakdown of ingest.
Expand Down
1 change: 1 addition & 0 deletions sidebars.ts
Original file line number Diff line number Diff line change
Expand Up @@ -1521,6 +1521,7 @@ module.exports = {
'metrics/metric-rules-editor',
'metrics/metrics-transformation-rules',
'metrics/logs-to-metrics',
'metrics/metrics-dpm',
'metrics/kubernetes-metrics',
],
},
Expand Down
Loading