You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/getting-started/data-scientists/overview.md
+9-14Lines changed: 9 additions & 14 deletions
Original file line number
Diff line number
Diff line change
@@ -12,33 +12,28 @@ Some other things you may be looking for are:
12
12
13
13
* Documentation about using [Jetstream](/deep-dives/jetstream/overview), Mozilla's experiment analysis tool
14
14
* Technical documentation about [datasets used in experimentation](https://docs.telemetry.mozilla.org/tools/experiments.html)
15
-
*[Process documentation](https://mozilla-hub.atlassian.net/wiki/spaces/DATA/overview) for the Mozilla data science organization
16
-
(internal link)
15
+
*[Process documentation](https://experimenter.info/for-product) for the Mozilla data science organization
17
16
18
17
## What is the role of experimentation at Mozilla?
19
18
20
19
Experimentation informs product decision-making at Mozilla.
21
20
This suite of experimentation tools is designed for product managers and other investigation owners to A/B test hypotheses they have about new and existing products and features.
and the [experiment review repository](https://mozilla-hub.atlassian.net/wiki/spaces/FIREFOX/pages/11043456/Experiments+Previously+Reviewed) (internal link)
24
-
contain examples of completed and active experiments.
21
+
[Experimenter](https://experimenter.services.mozilla.com/nimbus/) (internal link) contains examples of completed and active experiments.
25
22
26
23
## Collaborating with experiment owners
27
24
28
25
Data scientists support experiment owners in setting up and interpreting their experiments.
explains how to set up an experiment in the experiment console.
34
-
35
-
The support that experiment owners need from data scientists during experiment set-up includes:
28
+
Experiment owners come to [Office Hours](https://docs.google.com/document/d/1dH-aG8IsYtq6881_Q_cyEtmxli0bK7nuVcUD-5D7q-s/edit#) to talk to data scientists to:
36
29
37
30
* validating that the experimental design will answer their questions
38
31
* consulting on telemetry specifications
39
-
* sample size recommendations
32
+
* sample size recommendations based on the target audience + learning goals
33
+
* guidance about interpretation of results
34
+
35
+
If there is follow work needed outside of office hours, a Data Org Jira ticket is filed. Example:
40
36
* writing [custom metrics](/deep-dives/jetstream/metrics) if needed
41
-
* guidance about interpretation
42
37
43
38
## Sampling framework
44
39
@@ -50,7 +45,7 @@ For more nuances about sampling, enrollment and exposure (whether or not the cli
50
45
51
46
## Sample size recommendations
52
47
53
-
Sample size recommendations are operationalized as the fraction of the Firefox population that should consider enrolling in your recipe. This is determined by discussing your [experiment design document](https://docs.google.com/document/d/1_bWn_1y5x1zf6zl7Loj4O1qKnVdxzIMXOawIpf32CsM/edit) at either [desktop or mobile data science office hours](https://mozilla-hub.atlassian.net/wiki/spaces/DATA/pages/6849684/Office+Hours).
48
+
Sample size recommendations the fraction of the Firefox population that should be enrolled in your recipe. This is determined by discussing your [experiment design document](https://docs.google.com/document/d/1_bWn_1y5x1zf6zl7Loj4O1qKnVdxzIMXOawIpf32CsM/edit?tab=t.0) at [Data science office hours](https://docs.google.com/document/d/1dH-aG8IsYtq6881_Q_cyEtmxli0bK7nuVcUD-5D7q-s/edit#).
54
49
55
50
The information in the [Experiment brief](https://docs.google.com/document/d/1_bWn_1y5x1zf6zl7Loj4O1qKnVdxzIMXOawIpf32CsM/edit) needs to provide the information needed for sizing.
0 commit comments