Skip to content

docs(audit): runtime identity/HITL consistency audit + correct langgraph version claim - #18

Merged
Xander-Xai merged 2 commits into
mainfrom
audit/runtime-identity-hitl-consistency-20261019
Oct 18, 2026
Merged

Xander-Xai merged 2 commits into
mainfrom
audit/runtime-identity-hitl-consistency-20261019

Conversation

@Xander-Xai

Copy link
Copy Markdown
Owner

What & why

Consistency audit of the claimed AgentRuntime / PostgreSQL checkpoint / Celery /
Redis lease / idempotent tool execution / HITL / crash recovery
capabilities
against live main (8e45f99), executed on real PostgreSQL + Redis.

No new reproducible code defect. The Issue #12 (Part A/B + partial-resume),
#13 and #14 fixes are re-verified as PASS on real infrastructure.

One stale fact was corrected: live docs/comments claimed HITL LangGraph
semantics were "实测 langgraph 1.2.12", but requirements-lock.txt pins
1.2.2, the venv installs 1.2.2, and a fresh chaos artifact records
1.2.2 — so a lockfile install cannot reproduce a 1.2.12 claim. Live
references are aligned to 1.2.2 and the docs/limitations.md §9 debt entry is
closed, with the HITL interrupt/resume suite as regression evidence. Historical
audit snapshots are untouched (snapshot-not-backfilled).

Deliverable

  • docs/audit/2026-10-19-runtime-identity-hitl-consistency-audit.md — HEAD/sync
    record, capability → file/symbol/test map, reproduced fault matrix, fast-path
    vs durable-run authorization boundary, unresolved risks, interview-usable
    phrasing.

Verification (real PG + Redis)

Command Result
pytest tests/unit -q 3481 passed, 5 skipped
pytest tests/integration/runtime -q 199 passed
pytest tests/integration/runtime/test_celery_delivery_semantics.py 8 passed
python scripts/test_worker_crash_recovery.py PASS
python scripts/verify_distributed_runtime.py overall_status: PASS
pytest test_hitl_langgraph_interrupt.py test_runtime_doc_drift.py 71 passed
python scripts/audit_doc_consistency.py OK (57 active docs)
ruff check / ruff format --check (changed files) clean

Boundary (unchanged, not overclaimed)

At-least-once, not exactly-once; external end-to-end exactly-once
NOT PROVIDED; real ERP write NOT_VERIFIED; production cluster /
multi-replica NOT_VERIFIED; no monotonic fencing token; RAG formal metrics
NOT_VERIFIED; cache hit-rate / latency deltas NOT_MEASURED.

Draft pending review + CI.

Customer Service AI Agent and others added 2 commits October 19, 2026 01:35
…aph version claim

Audit scope: AgentRuntime / PostgreSQL checkpoint / Celery / Redis lease /
idempotent tool execution / HITL / crash recovery. Verified against live main
(8e45f99) with real PostgreSQL + Redis.

No new reproducible code defect found. The Issue #12 (Part A/B + partial-resume),
#13 and #14 fixes re-verified as PASS on real infrastructure (199 runtime
integration + 3481 unit + chaos/delivery/verify artifacts).

One stale fact corrected: live docs/comments claimed HITL LangGraph semantics
were "实测 langgraph 1.2.12", but requirements-lock.txt pins 1.2.2, the venv
installs 1.2.2, and a fresh chaos artifact records 1.2.2 — so a lockfile install
cannot reproduce a 1.2.12 claim. Align the live references (code comments,
CLAUDE.md, HITL design doc, test docstring) to 1.2.2 and close the
docs/limitations.md section 9 debt entry, with the HITL interrupt/resume test
suite as regression evidence. Historical audit snapshots are left untouched
(snapshot-not-backfilled convention).

Adds docs/audit/2026-10-19-runtime-identity-hitl-consistency-audit.md with the
capability -> file/symbol/test map, the reproduced fault matrix, boundaries
(at-least-once / not exactly-once / real ERP NOT_VERIFIED / production cluster
NOT_VERIFIED / RAG metrics NOT_VERIFIED / cache hit-rate NOT_MEASURED).
@Xander-Xai
Xander-Xai marked this pull request as ready for review October 18, 2026 18:06
@Xander-Xai
Xander-Xai merged commit 377cba0 into main Oct 18, 2026
11 checks passed
@Xander-Xai
Xander-Xai deleted the audit/runtime-identity-hitl-consistency-20261019 branch October 18, 2026 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant