Firefox Telemetry Experiments

Published Experiments

Plugin Block Testing

Start Date
02-May-2016
End Date
23-May-2016
Maximum runtime
21.0 days
Update Channels
beta
Firefox version(s)
47.0b3 - 47.*
Sample Rate
10%

Measuring the effect of blocking plugin content on crashes, hangs, and other browser jank.

Related bug

Multi-process Firefox A/B test 3 (Finished) (Disabled)

Start Date
07-Mar-2016
End Date
24-Mar-2016
Maximum runtime
15.0 days
Disabled
Update Channels
beta
Firefox version(s)
46.0
Sample Rate
50%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Measure the effect of multi-process Firefox

Related bug

DisplayPort Size Tuning (Finished)

Start Date
25-Feb-2016
End Date
19-Mar-2016
Maximum runtime
7.0 days
Update Channels
nightly
Firefox version(s)
47.0a1 - 48.*
Sample Rate
50%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled &&
         c.telemetryEnvironment.settings.e10sEnabled;
}

Measuring the effect of different displayport sizes on checkerboarding.

Related bug

Multi-process Firefox A/B test 2 (Finished) (Disabled)

Start Date
12-Feb-2016
End Date
25-Feb-2016
Maximum runtime
15.0 days
Disabled
Update Channels
beta
Firefox version(s)
45.0
Sample Rate
50%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Measure the effect of multi-process Firefox

Related bug

Multi-process Firefox A/B test (Finished)

Start Date
25-Jan-2016
End Date
11-Feb-2016
Maximum runtime
15.0 days
Update Channels
beta
Firefox version(s)
45.0
Sample Rate
50%
Filter Function
function filter(c) {
  let activeAddons = {};
  try {
    activeAddons = c.telemetryEnvironment.addons.activeAddons;
  } catch (e) {
    return false;
  }
  for (let addon of Object.keys(activeAddons)) {
    if (addon == "support@lastpass.com") {
      let version = new String(activeAddons[addon].version);
      // LastPass versions 3.* are known to have problems
      // with e10s, so let's skip the experiment for these users
      if (version.startsWith("3")) {
        return false;
      }
    } else if (addon == "{82af8dca-6de9-405d-bd5e-43525bdad38a}" ||
               addon == "{82AF8DCA-6DE9-405D-BD5E-43525BDAD38A}") {
      // Skype Click-To-Call add-on
      return false;
    }
  }
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Measure the effect of multi-process Firefox

Related bug

Unified Search in Urlbar (Finished) (Disabled)

Start Date
11-Jan-2016
End Date
24-Feb-2016
Maximum runtime
14.0 days
Disabled
Update Channels
beta
Firefox version(s)
44.0 - 45.*
Sample Rate
10%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Adds search features to the urlbar and moves the search bar to the customization panel

Related bug

Multi-process Firefox A/B test (Finished)

Start Date
14-Dec-2015
End Date
04-Jan-2016
Maximum runtime
30.0 days
Update Channels
beta
Firefox version(s)
44.0
Sample Rate
15%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Measure the effect of multi-process Firefox

Related bug

Search result pages in history (Finished)

Start Date
10-Nov-2015
End Date
24-Nov-2015
Maximum runtime
1.0 days
Update Channels
beta
Firefox version(s)
All
Build ID
20151109145326 -
Sample Rate
10%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

An experiment that measures what percentage of history visits are search result pages. The search percentage data is anonymous.

https://bugzilla.mozilla.org/show_bug.cgi?id=1174937

Multi-process Firefox A/B test (Finished)

Start Date
20-Sep-2015
End Date
01-Nov-2015
Maximum runtime
10.0 days
Update Channels
aurora
Firefox version(s)
43.0a2
Sample Rate
100%
Filter Function
function filter(c) {
  return c.telemetryEnvironment.settings.telemetryEnabled;
}

Measure the effect of multi-process Firefox

Related bug

Search Experiment - HK and TW (Finished)

Start Date
25-Mar-2015
End Date
07-May-2015
Maximum runtime
30.0 days
Update Channels
release
Firefox version(s)
35 - *
Locale(s)
zh-TW
Sample Rate
50%

Test alternate default search settings for users of Firefox in Hong Kong and Taiwan.

Related bug

Search Experiment (Finished)

Start Date
28-Jan-2015
End Date
07-Apr-2015
Maximum runtime
30.0 days
Update Channels
release
Firefox version(s)
35 - *
Locale(s)
tr
Sample Rate
70%

Test alternate default search settings for users of Firefox in Turkey.

Related bug

Plugin Video Usage Metrics (Finished)

Start Date
12-Jan-2015
End Date
23-Feb-2015
Maximum runtime
60.0 days
Update Channels
beta
Firefox version(s)
36.0 - *
Sample Rate
10%

A measurement experiment to determine which video sites use plugins and are most popular, so that Mozilla can prioritize and fix common video problems.

Related bug

Flash Protected-Mode Testing (Finished) (Disabled)

Start Date
15-Dec-2014
End Date
15-Jan-2015
Maximum runtime
32.0 days
Disabled
Update Channels
beta
Firefox version(s)
35.0 - 37.*
Build ID
20141215000000 -
Operating Systems
WINNT
Sample Rate
10%

Measuring the effect of Flash protected mode on crashes, hangs, and other browser jank.

Related bug

New Tab Data (Finished)

Start Date
10-Dec-2014
End Date
10-Jan-2015
Maximum runtime
7.0 days
Update Channels
beta
Firefox version(s)
33.0 - 37.*
Sample Rate
25%

An experiment to analyze the data on about:newtab, see bug 1062708.

Related bug

Invisible test for experiment branch correctness. (Finished)

Start Date
14-Aug-2014
End Date
10-Sep-2014
Maximum runtime
7.0 days
Update Channels
nightly
Firefox version(s)
34.0a - 35.*
Build ID
20140820030202 -
Sample Rate
50%

An experiment using branches to see if branch values are saved correctly, see bug 1052714.

Related bug

Automatic Translation (Finished)

Start Date
16-Jul-2014
End Date
25-Nov-2014
Maximum runtime
126.0 days
Update Channels
beta
Firefox version(s)
33.0 - *
Locale(s)
es-AR
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for es-AR users of Beta.

Automatic Translation (Finished)

Start Date
16-Jul-2014
End Date
25-Nov-2014
Maximum runtime
126.0 days
Update Channels
beta
Firefox version(s)
33.0 - *
Locale(s)
es-ES
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for es-ES users of Beta.

Automatic Translation (Finished)

Start Date
16-Jul-2014
End Date
25-Nov-2014
Maximum runtime
126.0 days
Update Channels
beta
Firefox version(s)
32.0 - *
Build ID
20140630004007 -
Locale(s)
pl
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for Polish users of Beta.

Automatic Translation (Finished)

Start Date
16-Jul-2014
End Date
25-Nov-2014
Maximum runtime
126.0 days
Update Channels
beta
Firefox version(s)
32.0 - *
Build ID
20140630004007 -
Locale(s)
tr
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for Turkish users of Beta.

Automatic Translation (Finished)

Start Date
16-Jul-2014
End Date
25-Nov-2014
Maximum runtime
126.0 days
Update Channels
beta
Firefox version(s)
32.0 - *
Build ID
20140630004007 -
Locale(s)
vi
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for Vietnamese users of Beta.

Search Experiment (Finished)

Start Date
01-Jul-2014
End Date
30-Sep-2014
Maximum runtime
28.0 days
Update Channels
beta
Firefox version(s)
31.0a - 32.*
Build ID
20140630185627 -
Locale(s)
en-US
Sample Rate
50%

Test alternate default search settings for users of Firefox beta.

This experiment divides users into five groups: a control and four test groups with various default search parameters and notification settings.

OOPP container unload timeout tester (Finished)

Start Date
01-Jul-2014
End Date
02-Sep-2014
Maximum runtime
42.0 days
Update Channels
beta
Firefox version(s)
32.0 - 34.*
Sample Rate
5%

An experiment using branches to set a value for dom.ipc.plugins.unloadTimeoutSecs preference (see bug 1018200).

Related bug

Automatic Translation (Finished)

Start Date
27-Jun-2014
End Date
01-Aug-2014
Maximum runtime
36.0 days
Update Channels
aurora
Firefox version(s)
32.0a - *
Build ID
20140630004007 -
Locale(s)
de
Sample Rate
100%

Read more of the web by automatically translating sites written in different languages.

Available for German users of Aurora.

Reorder about:newtab tiles (Finished)

Start Date
01-Jan-2014
End Date
15-May-2014
Maximum runtime
5.0 days
Update Channels
nightly
Firefox version(s)
All
Sample Rate
25%
Filter Function
function filter(c) {
  var addons = c.healthReportPayload.data.last['org.mozilla.addons.addons'];
  var tst = addons['treestyletab@piro.sakura.ne.jp'];
  if (tst !== undefined && !tst.userDisabled) {
    throw Error("Tree-style tabs present");
  }
  var ctr = addons["ClassicThemeRestorer@ArisT2Noia4dev"];
  if (ctr !== undefined && !ctr.userDisabled) {
    return false;
  }
  return true;
}

Changes the ordering of the most-used tiles in about:newtab.

Source Code

About Experiments

Telemetry Experiments are new or experimental features which are made available to some Firefox users who have Telemetry enabled. For more information, see the following pages: