Skip to content

fix: bind Evals releases to exact CI and notices - #339

Merged
abrichr merged 2 commits into
mainfrom
codex/evals-release-boundary-20260903
Sep 3, 2026
Merged

fix: bind Evals releases to exact CI and notices#339
abrichr merged 2 commits into
mainfrom
codex/evals-release-boundary-20260903

Conversation

@abrichr

@abrichr abrichr commented Sep 3, 2026

Copy link
Copy Markdown
Member

PR #338 could not safely merge because the tag job did not check CI for the post-merge main SHA, and the archives omitted VAGEN's required MIT notice. This fixes both release boundaries before the bot proposes 0.97.0 again.

The release job now queries the test.yml push runs for the requested 40-character main SHA. It refuses missing, pending, failed, cancelled, timed-out, API-error, and SHA-mismatched evidence before it creates a release App token. A dispatch made before the exact push run completes must be tried again.

The wheel contains modified copies of two VAGEN abstract environment files. NOTICE records the source repository, commit, paths, upstream and distributed SHA-256 values, modification state, and the full upstream MIT notice. Both pull-request CI and the release job inspect the built wheel and sdist. A changed vendored file, missing notice, or changed archive notice now fails.

Verification:

  • Locked CI test selection: 2,685 passed, 57 skipped, 17 deselected.
  • Locked Ruff check: passed.
  • Wheel and sdist build: passed.
  • Source-policy and third-party notice archive gates: passed.
  • Focused release tests: 24 passed.

The copied files first entered at c7845ff. Tagged v0.25.0 and later releases contain that commit. This pull request stops the notice omission in the next release. Audit the historical PyPI files and make any yank decision only after a compliant replacement is live.

Opened by an agent session, not the founder.

@abrichr
abrichr merged commit 5d0a01a into main Sep 3, 2026
2 checks passed
@abrichr
abrichr deleted the codex/evals-release-boundary-20260903 branch September 3, 2026 04:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant