Skip to content

fix: fetch Cacheon docs via a single GitHub archive - #103

Merged
clementblaise merged 6 commits into
mainfrom
fix-docs-import-rate-limit
Aug 25, 2026
Merged

clementblaise merged 6 commits into
mainfrom
fix-docs-import-rate-limit

Conversation

@clementblaise

@clementblaise clementblaise commented Aug 24, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

  • The docs importer was making ~79 unauthenticated raw.githubusercontent.com requests per build (one per nav page/redirect), which gets rate-limited on Cloudflare's shared build IPs.
  • createRemoteSource now resolves the ref to a SHA, downloads a single GitHub repo tarball, and reads mkdocs.yml/docs/ from the extracted tree — 2 GitHub API calls total instead of 79.
  • Added retry-with-backoff (honoring Retry-After) on the two GitHub API calls, and dispose() cleanup of the extracted temp directory.
  • GITHUB_TOKEN now authenticates both calls (previously only ref resolution)
  • Remove stale doc pages

Test plan

  • npm run test:docs — 16/16 passing, including new tests for thetarball round-trip, 429 retry, and missing-root-dir rejection
  • npm run format:check
  • Verified end-to-end against the live latent-to/cacheon repo via
    npm run docs:import

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Aug 24, 2026 •

Copy link
Copy Markdown

Deploying with  Cloudflare Workers  Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status Name Latest Commit Preview URL Updated (UTC)
✅ Deployment successful!
View logs
cacheon-frontend 231cf73 Commit Preview URL

Branch Preview URL
Aug 24 2026, 02:47 PM

@clementblaise
clementblaise marked this pull request as ready for review August 24, 2026 14:40
Introduce new dashboard link and remove old dashboard logic
@clementblaise
clementblaise merged commit 1ac218b into main Aug 25, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants