Skip to content

chi-bench: Bin_Han · openai-agents · mimo-v2.6-pro - #30

Open
Bin-H-17 wants to merge 2 commits into
actava-ai:mainfrom
Bin-H-17:sub/chi-bench/2026-10-13-bhan-mimo26-full75
Open

Bin-H-17 wants to merge 2 commits into
actava-ai:mainfrom
Bin-H-17:sub/chi-bench/2026-10-13-bhan-mimo26-full75

Conversation

@Bin-H-17

Copy link
Copy Markdown

Partial packet: 4/75 trials (pa_provider), full run in progress.

  • agent: openai-agents, model: mimo-v2.6-pro (chat_completions)
  • dataset: chi-bench-v1.0.0, n_attempts=1
  • validate.py: 0 errors, 0 warnings

Full 75-task packet will follow once the run completes.

The branch previously carried a 4-trial partial (4/75). This replaces it with the completed run: pa_provider 25/25, pa_um 22/25, cm 25/25. Overall pass@1 18.06% (13/72). Three pa_um trials (t008, t016, t034) failed during execution and are excluded rather than reported.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant