Bug 2059826 - Simplified View: Create checkbox selection for advanced columns and display how to read the results - #1069
Open
kala-moz wants to merge 10 commits into
Open
Bug 2059826 - Simplified View: Create checkbox selection for advanced columns and display how to read the results#1069kala-moz wants to merge 10 commits into
kala-moz wants to merge 10 commits into
Conversation
✅ Deploy Preview for mozilla-perfcompare ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
kala-moz
marked this pull request as draft
July 24, 2026 02:14
kala-moz
requested review from
beatrice-acasandrei,
esanuandra,
gmierz and
padenot
and removed request for
padenot
July 24, 2026 02:32
kala-moz
marked this pull request as ready for review
July 24, 2026 02:36
Contributor
|
It looks great! |
kala-moz
changed the title
kala-moz
force-pushed
the
simplified-view-phase1
branch
from
August 4, 2026 23:48
0ee7631 to
9a74697
Compare
… CLES Hidden by default; the choice persists to localStorage. Available on both the main and subtests pages.
kala-moz
force-pushed
the
simplified-view-phase1
branch
from
August 5, 2026 22:23
52293fe to
aada4b7
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Deploy link
Bug 2059826
Summary
Introduces a beginner-friendly "simplified" results view for the Mann-Whitney-U comparison table, while keeping the full statistical detail only check-boxes away. New contributors get plain-language columns and an on-page reading guide by default; power users can reveal the advanced stats columns with specific checkboxes (persists in the url).
User-facing changes
Δ Median % (renamed from MD (%)) — now computed from the raw runs' medians ((median(new) − median(base)) / median(base) × 100), which matches both the expanded panel's bootstrap median-diff and the reference perfcompare-new-stats implementation. Formatted as a signed, 2-decimal percent (+1.08% / −2.40%); a warning icon flags non-normal distributions (the value is still shown, since the median is rank-based); shows +0.00% for a zero base median and - only when there are no runs.
Magnitude: Move the Cliff's Delta interpretation into its own "Magnitude" column (simplified view only) so users can sort and filter by effect size.
Significance is shown in both views and now uses words instead of symbols — "Real" (significant) / "Noise" (not significant), with matching filter labels. The header reads "Significance" in the simplified view and abbreviates to "Sig" in the advanced view so it doesn't crowd "Total Trials".
Advanced columns dropdown: contains independent Cliff's Delta and CLES checkboxes (either/both/neither). Stored the Cliff's Delta / CLES visibility in an
advanced_columnsURL param (comma list, absent = none) so a shared or bookmarked link reproduces the selected columns."How to read the results" panel: A dismissible guide above the table explaining each column in plain English. Shown by default for new users; the close button or the "How to read the results" checkbox toggles it, and the choice is remembered.
Notable decisions / follow-ups
Defaults: simplified view and the reading panel are on by default (dismissible, remembered). Easy to flip if we'd rather not change the default for existing users.
Scope: the reading panel is on the main results view only (not the subtests drill-down) — easy to add there if wanted.
Phase 2 candidate: simplify the expanded row.
🤖 Generated with the help of Claude Code