Skip to content

test: isolate release fixtures from workflow changes - #523

Merged
neilime merged 1 commit into
mainfrom
fix/release-test-target
Nov 15, 2026
Merged

neilime merged 1 commit into
mainfrom
fix/release-test-target

Conversation

@neilime

@neilime neilime commented Nov 15, 2026 •

Copy link
Copy Markdown
Member

Main CI fails when generated workflow documentation advances main before the release tests create a draft for the triggering SHA. GitHub rejects that historical workflow tree with 403 Resource not accessible by integration, despite contents: write (failed job, GitHub permission requirements).

Create an unreferenced fixture commit based on the tested commit, with .github/workflows removed from its tree, for both release creation and deletion tests. The actions still execute from the tested checkout. Preserve exact target-SHA assertions, draft updates, asset verification, publication without Git metadata, and unconditional release/tag cleanup. Branches and token permissions are unchanged.

Validation: actionlint, the repository Super-Linter on both changed workflows, and git diff --check pass. All 109 PR checks passed. Existing hosted scenarios exercised the real GitHub API with GITHUB_TOKEN: release/create completed in 24 seconds and release/delete in 57 seconds. Fixture preparation took about one second per job (three Git API requests). Test tags and releases were removed. No mock-based duplicate tests were added.

@github-actions github-actions Bot added the type: maintenance Performs maintenance work label Nov 15, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Internal - Pull request - Continuous Integration - Test results

Workflow run and full reports · Commit 1bf4760

Jobs: 5 success · 0 failure · 0 cancelled · 0 skipped · 0 abandoned.

Test: 116 passed · 0 failed · 0 skipped.

Test details

Test results

Test Results

Status Count
✅ Passed 116
❌ Failed 0
⏭️ Skipped 0
Total 116
Suite Passed Failed Skipped
AssetManager.copyAssetFromWorkspace 1 0 0
AssetManager.rewriteContent 1 0 0
createSitePage 1 0 0
GitEvidenceService 2 0 0
index.run 1 0 0
LinkEvidenceService 1 0 0
LlmSummaryService 2 0 0
LlmSummaryService provider retries 15 0 0
prepareSite 1 0 0
ReleaseSummaryCore 4 0 0
rewritePageLinks 1 0 0
Unknown Suite 84 0 0
WorkspacePathResolver.resolveExistingWithinWorkspace 2 0 0

✅ Pass Rate: 100.0%

Job results and report availability
Job Result Report artifacts
lint success 1
test-action-deploy-jekyll-jampack success 2
test-action-release-get-configuration success 1
test-action-release-prepare-and-plan success 2
test-action-release-summarize-changelog success 1

Only this attempt is included. On partial reruns, rerun all producer jobs for complete reports. CodeQL findings remain in code scanning; other diagnostics remain in the job logs.

@github-actions

Copy link
Copy Markdown
Contributor

Internal - Pull request - Continuous Integration - Code coverage

Workflow run and full reports · Commit 1bf4760

Jobs: 5 success · 0 failure · 0 cancelled · 0 skipped · 0 abandoned.

Coverage: 5 source report(s); percentages remain separate.

Coverage details

Coverage results

ci-reports-1-test-action-deploy-jekyll-jampack-actions-deploy-jekyll-a2fb67d9-8825-4645-9f72-a9fe0282d702/lcov.info

Coverage

Metric Covered Total Percentage
Lines 638 707 90.24%
Branches 74 114 64.91%
Functions 45 45 100.00%

Overall: 90.24% 🟢
🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩⬜⬜

ci-reports-1-test-action-release-get-configuration-actions-release-get-configuration-0aca6fd4-0e77-444a-8c86-19adef347f91/lcov.info

Coverage

Metric Covered Total Percentage
Lines 75 81 92.59%
Branches 18 21 85.71%
Functions 4 5 80.00%

Overall: 92.59% 🟢
🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩⬜

ci-reports-1-test-action-release-prepare-and-plan-actions-release-plan-26e7501e-2d07-4206-964a-6fa746337828/lcov.info

Coverage

Metric Covered Total Percentage
Lines 93 93 100.00%
Branches 34 34 100.00%
Functions 3 3 100.00%

Overall: 100.00% 🟢
🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩

ci-reports-1-test-action-release-prepare-and-plan-actions-release-prepare-d0665860-6eae-4b8e-b466-2249bbdcb588/lcov.info

Coverage

Metric Covered Total Percentage
Lines 4961 9032 54.93%
Branches 633 1074 58.94%
Functions 224 485 46.19%

Overall: 54.93% 🔴
🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥🟥⬜⬜⬜⬜⬜⬜⬜⬜⬜

ci-reports-1-test-action-release-summarize-changelog-actions-release-summarize-changelog-cca3cb79-0688-4f8e-8e72-fcb5f253ae66/lcov.info

Coverage

Metric Covered Total Percentage
Lines 624 808 77.23%
Branches 79 115 68.70%
Functions 33 37 89.19%

Overall: 77.23% 🟡
🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨🟨⬜⬜⬜⬜⬜

Job results and report availability
Job Result Report artifacts
lint success 1
test-action-deploy-jekyll-jampack success 2
test-action-release-get-configuration success 1
test-action-release-prepare-and-plan success 2
test-action-release-summarize-changelog success 1

Only this attempt is included. On partial reruns, rerun all producer jobs for complete reports. CodeQL findings remain in code scanning; other diagnostics remain in the job logs.

@github-actions

Copy link
Copy Markdown
Contributor

Internal - Pull request - Continuous Integration - Lint results

Workflow run and full reports · Commit 1bf4760

Jobs: 5 success · 0 failure · 0 cancelled · 0 skipped · 0 abandoned.

Lint: Collected diagnostics and Super-Linter summaries. Execution status is included in the job outcomes.

Super-Linter details

Super-linter summary

Language Validation result
BIOME_FORMAT Pass ✅
BIOME_LINT Pass ✅
CHECKOV Pass ✅
GITHUB_ACTIONS Pass ✅
GITHUB_ACTIONS_ZIZMOR Pass ✅
GITLEAKS Pass ✅
GIT_COMMITLINT Pass ✅
GIT_MERGE_CONFLICT_MARKERS Pass ✅
JSCPD Pass ✅
PRE_COMMIT Pass ✅
SPELL_CODESPELL Pass ✅
TRIVY Pass ✅
YAML Pass ✅
YAML_PRETTIER Pass ✅

All files and directories linted successfully

For more information, see the GitHub Actions workflow run

Powered by Super-linter
Super-linter revision: 2da136927bd4a73596db63044b504547c62cb854
Super-linter version: 9.0.0

Job results and report availability
Job Result Report artifacts
lint success 1
test-action-deploy-jekyll-jampack success 2
test-action-release-get-configuration success 1
test-action-release-prepare-and-plan success 2
test-action-release-summarize-changelog success 1

Only this attempt is included. On partial reruns, rerun all producer jobs for complete reports. CodeQL findings remain in code scanning; other diagnostics remain in the job logs.

@neilime
neilime merged commit c3cd9bb into main Nov 15, 2026
110 checks passed
@neilime
neilime deleted the fix/release-test-target branch November 15, 2026 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type: maintenance Performs maintenance work

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant