Skip to content

feat: add CRPSS (skill score) - #1184

Draft
MentReeze wants to merge 4 commits into
mainfrom
feature/add_CRPSS
Draft

MentReeze wants to merge 4 commits into
mainfrom
feature/add_CRPSS

Conversation

@MentReeze

@MentReeze MentReeze commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do?

Adds CRPSS: continuous ranked probability skill score, and weighted variant.
Skill score needs a reference forecast, which is added to evaluation pipeline.
Sample weights for weighted CRPSS are based on reference period.

Weighted CRPSS example when evaluated for day-ahead forecasts with a reference window of 14 days:
image

Closes #

Type of change

  • Bug fix
  • New feature
  • Breaking change (see checklist below)
  • Documentation
  • Refactor / chore / CI

Breaking changes checklist

  • Public API, config schema, or serialized/pickled objects changed in a way that affects existing users
  • If yes: see the breaking changes guide for the pickle/_migrate_state migration pattern

Migration path for existing users (e.g. "old pickled XScaler objects auto-migrate on load", "users must now pass X explicitly"):

AI disclosure

  • No AI assistance was used (beyond grammar/spelling)
  • AI assistance was used — tool(s):
    • I have reviewed, understand, and can explain all AI-generated code in this PR
    • This is disclosed in a commit message (e.g. Assisted-by: <tool name>)

Checklist

  • poe all --check passes locally
  • Tests added/updated for the change
  • Documentation updated (docstrings, user guide, examples) if needed
  • Commits are signed off per our DCO (git commit -s)
  • PR title follows Conventional Commits (e.g. feat: ..., fix: ..., feat!: ... for breaking changes)

Signed-off-by: MentReeze <ment.reeze@alliander.com>
@github-actions github-actions Bot added the feature New feature or request label Nov 10, 2026
@MentReeze MentReeze changed the title Add CRPSS (skill score) feat: add CRPSS (skill score) Nov 10, 2026
MentReeze and others added 2 commits November 11, 2026 14:13
…ast computation

Signed-off-by: MentReeze <ment.reeze@alliander.com>
Signed-off-by: Lars Schilders <lars.schilders@alliander.com>
@sonarqubecloud

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
79.0% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube Cloud

Signed-off-by: MentReeze <ment.reeze@alliander.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants