Skip to content

RMST-302: Create a derived dataset for Remote Settings uptake telemetry#9085

Merged
BenWu merged 14 commits intomozilla:mainfrom
leplatrem:rmst-302
Mar 31, 2026
Merged

RMST-302: Create a derived dataset for Remote Settings uptake telemetry#9085
BenWu merged 14 commits intomozilla:mainfrom
leplatrem:rmst-302

Conversation

@leplatrem
Copy link
Copy Markdown
Contributor

Description

We are migrating our client uptake telemetry away from the legacy stack.

We want telescope to be able to read uptake telemetry like it did in sql/moz-fx-data-shared-prod/telemetry_derived/events_live/metadata.yaml
And ideally we would like to query live data in Grafana to be able to correlate the data publication in our servers with client behaviour.

According to my current understanding and navigation within the data eng constellation, this PR would be the way to go.

Related Tickets & Documents

Reviewer, please follow this checklist

@leplatrem
Copy link
Copy Markdown
Contributor Author

For reference, this is the kind of queries that we'll run down the line in telescope (source)

SELECT
  PARSE_TIMESTAMP('%s', CAST(UNIX_SECONDS(submission_timestamp) - MOD(UNIX_SECONDS(submission_timestamp), 600) AS STRING)) AS period,
  CASE WHEN extra_status = 'success' THEN 'success' ELSE 'error' END AS status,
  COUNT(DISTINCT client_id) AS n_client_id,
  COUNT(DISTINCT IF(normalized_channel IN ('release', 'esr'), client_id, NULL)) * 100 AS n_client_id_release,
  COUNT(DISTINCT IF(normalized_channel = 'nightly', client_id, NULL)) AS n_client_id_nightly,
  COUNT(DISTINCT IF(normalized_channel NOT IN ('release', 'esr', 'nightly'), client_id, NULL)) AS n_client_id_other
FROM
  `moz-fx-data-shared-prod.monitoring_derived.remote_settings_uptake_live_v1`
WHERE submission_timestamp > TIMESTAMP_SUB(CURRENT_TIMESTAMP(), INTERVAL 3 HOUR)
  AND extra_status NOT IN ('up_to_date', 'network_error', 'offline_error', 'shutdown_error')
GROUP BY period, status

Copy link
Copy Markdown
Contributor

@chutten chutten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, I like it. I have some outstanding questions for folks more expert than me, so I'll reach out on Slack#data-help for their attention.

leplatrem and others added 4 commits March 27, 2026 10:07
…_uptake_live_v1/metadata.yaml

Co-authored-by: Chris H-C <chutten@users.noreply.github.com>
…_uptake_live_v1/view.sql

Co-authored-by: Ben Wu <12437227+BenWu@users.noreply.github.com>
…_uptake_live_v1/view.sql

Co-authored-by: Chris H-C <chutten@users.noreply.github.com>
Copy link
Copy Markdown
Contributor

@BenWu BenWu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a few small things

Comment thread sql/moz-fx-data-shared-prod/monitoring/remote_settings_uptake_live_v1/view.sql Outdated
leplatrem and others added 2 commits March 31, 2026 10:41
Co-authored-by: Ben Wu <12437227+BenWu@users.noreply.github.com>
@leplatrem leplatrem requested a review from BenWu March 31, 2026 16:03
Copy link
Copy Markdown
Contributor

@BenWu BenWu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just trying to get it through CI

@BenWu BenWu added this pull request to the merge queue Mar 31, 2026
Merged via the queue into mozilla:main with commit 9eddd5a Mar 31, 2026
60 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants