Skip to content

Commit 08d07d5

Browse files
authored
Update metrics.md (#709)
made more robust info around guardrail metrics
1 parent 15cf2e1 commit 08d07d5

File tree

1 file changed

+64
-3
lines changed

1 file changed

+64
-3
lines changed

docs/deep-dives/jetstream/metrics.md

Lines changed: 64 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -35,11 +35,72 @@ within and between branches of an experiment.
3535
A small set of default, critical guardrail metrics that are specific to each platform are run by default for each experiment. Sometimes also called Core metrics.
3636
These are defined for each platform in the metric-hub repository in [jetstream/defaults/](https://github.com/mozilla/metric-hub/tree/main/jetstream/defaults/). Look at the file for your platform. At the top you will see the metrics collected and the timeframe they are available: daily, weekly, or overall (at the end of the experiment). For help understanding any aspect of guardrail metrics on your platform - link to the file and ask in #ask-experimenter.
3737

38-
[Pre-defined Metrics, AKA Outcomes](https://experimenter.info/deep-dives/jetstream/outcomes) are collections of metrics that relate to each other. You can associate these pre-defined metrics (outcomes) with your experiment in the Experiment Console - Metrics section.
39-
Data scientists can extend and define outcomes in the outcomes path of the
38+
[Pre-defined Metrics, AKA Outcomes](https://experimenter.info/deep-dives/jetstream/outcomes) are collections of metrics that relate to each other. You must associate these pre-defined metrics (outcomes) with your experiment BEFORE LAUNCH in the Experiment Console - Metrics section.
39+
Data scientists can extend and defined outcomes in the outcomes path of the
4040
[`metric-hub`](https://github.com/mozilla/metric-hub/tree/main/jetstream/outcomes) repository. See what [Outcomes are available](https://mozilla.github.io/metric-hub/outcomes/fenix/default-browser/).
4141

42-
If the metrics you need are not covered by Default (guardrail) or existing Pre-defined Outcomes - you can add a metric to your experiment by working with a data scientist to write a [custom configuration](https://experimenter.info/system-architecture#custom-configuration-aka-jetstream-configuration-files) for your experiment.
42+
If the metrics you need are not covered by Default (guardrail) or existing Pre-defined Outcomes - you can add a custom metric to your experiment by working with a data scientist to write a [custom configuration](https://experimenter.info/system-architecture#custom-configuration-aka-jetstream-configuration-files) for your experiment.
43+
44+
## What are the default guardrail metrics?
45+
Open the [file for your platform](https://github.com/mozilla/metric-hub/tree/main/jetstream/defaults) to see the most recent list of what is included. These don’t change often, but they can.
46+
47+
The guardrail metrics for [Desktop](https://github.com/mozilla/metric-hub/blob/main/jetstream/defaults/firefox_desktop.toml) as of June 2025.
48+
49+
KPI
50+
- "retained",
51+
- "Days_of_use",
52+
Engagement and KPI
53+
- "active_hours",
54+
- "Qualified_cumulative_days_of_use",
55+
- "Client_level_daily_active_users_v2",
56+
- "uri_count"
57+
58+
Search Related
59+
- "Ad_clicks",
60+
- "Organic_search_count",
61+
- "search_count",
62+
- "searches_with_ads",
63+
- "tagged_search_count",
64+
- "tagged_follow_on_search_count",
65+
- "Uri_count"
66+
67+
Leading indicators. KPI's are hard to move, but these are known positive leading indicators that can impacted KPI metrics.
68+
- "Is_default_browser",
69+
70+
The guardrail metrics for [Android](https://github.com/mozilla/metric-hub/blob/main/jetstream/defaults/fenix.toml) as of June 2025.
71+
72+
KPI metrics:
73+
- "retained",
74+
- "days_of_use",
75+
76+
Engagement with browser metrics:
77+
- "Active_hours"
78+
- "Total_uri_count",
79+
- "Client_level_daily_active_users_v2",
80+
81+
Search related metrics:
82+
- "Serp_ad_clicks",
83+
- "Organic_searches",
84+
- "Search_count",
85+
- "Searches_with_ads",
86+
- "Tagged_follow_on_searches",
87+
88+
89+
The guardrail metrics for [iOS](https://github.com/mozilla/metric-hub/blob/main/jetstream/defaults/firefox_ios.toml) as of June 2025.
90+
91+
KPI
92+
- "Days_of_use",
93+
- "retained",
94+
95+
Engagement
96+
- "Active_hours",
97+
- "client_level_daily_active_users_v2",
98+
99+
Search Related
100+
- "search_count",
101+
- "serp_ad_clicks",
102+
103+
43104

44105

45106

0 commit comments

Comments
 (0)