docs(examples): example-catalog verification report + agent server-version requirement (report only, no fixes)#438
Draft
ling-senpeng13 wants to merge 2 commits into
Draft
docs(examples): example-catalog verification report + agent server-version requirement (report only, no fixes)#438ling-senpeng13 wants to merge 2 commits into
ling-senpeng13 wants to merge 2 commits into
Conversation
…nt server-version requirement Report-only PR — no code changes. Tracks the verified status of every SDK example against conductor-oss 3.32.0-rc.8 (agents suite: 96 PASS / 46 SKIP / 2 ERROR / 2 HUNG with the companion fixes PR applied; 3 PASS / 103 ERROR on the CLI's `latest` 3.30.x server), the bugs found, and the remaining known failures. Fixes are proposed separately as a draft PR. Docs: the agent examples require conductor-oss >= 3.32.0-rc.8 (agent runtime on by default); documented in examples/agents/README.md and examples/README.md with `conductor server start --version 3.32.0-rc.8`. Also fixed the provider/model table (OpenAI row showed the Anthropic default string). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Codecov Report✅ All modified and coverable lines are covered by tests. 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Report + documentation only — no code changes. Replaces #437 (closed), split so the fixes can be evaluated separately; the companion draft PR #439 contains the fixes.
latest(3.30.x) has no/api/agent/*endpoints, so every agent example fails withAgentNotFoundError: HTTP 404— on 3.30.2 the suite scores 3 PASS / 103 ERROR vs 96 PASS on rc.8. Documentedconductor server start --version 3.32.0-rc.8inexamples/agents/README.mdandexamples/README.md(deliberately not changing the CLI or any version pin —latestself-resolves at 3.32.0 GA). Also fixed the provider/model table (OpenAI row showed the Anthropic default model string).Test status snapshot
latest(3.30.2)Failure disposition at a glance (fixes live in #439)
22 examples failed or misbehaved during verification (15 agents suite, 7 core suite):
Remaining known failures (details + diagnosis in the report):
kitchen_sink.py(server-sidetranslation_swarmsub-workflow registration, HTTP 500),74_cli_error_output.py(flaky LLM-behavior assertion),86_coding_agent.py(hangs >420s solo),68_context_condensation.py(passes solo ~346s, exceeds suite timeout under contention).