docs: add Seal as an RL reward - #196
Merged
Merged
Conversation
Adds docs/commercial/seal-reward.md to the Commercial section beside The Seal and the Execute page, and links it from The Seal and Effect verification. Types and evals commands come from merged code; the flow worker commands are pinned to openadapt-flow#452 until it merges. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds
docs/commercial/seal-reward.md, "Seal as an RL reward", to the Commercial section beside The Seal and the Execute page, with back-links from The Seal and Effect verification.What the page states
verified; screen-only evidence is never certified; a reward receipt is not an Execute Seal; unscored episodes are dropped, never paid 0.certifiedrule, includingcalibration_scope(synthetictoday;productionneeds the unpublished Phase-1 calibration). No epsilon or delta value appears on the page.CertifiedRewardFunction, verlCertifiedRewardManager, and theopenadapt-mockmed-extradupverifiers environment.Where every command comes from
RewardContractV1,RewardCertificateV1,RewardOutcomeV1,RewardEvidenceReceiptV1,score, the outcome tablecalibration_scope,issuer,production_certifiedHttpRewardEndpoint,CertifiedRewardFunction,metadata_columns,as_async,CertifiedRewardManager,register_with_verl,python -m openadapt_evals.reward.proofenvironments/openadapt_mockmed_extradup,vf-eval,scripted_policy.py serve,check_fails_closed.pyopenadapt-flow serve-reward,--contract,--port,--seed-mockmed, the routes, the envelope fields, the MockMed descriptorsf90f723b)Checks run locally
uv run mkdocs build --strict,uv run python scripts/validate_docs.py, andtests/test_validate_docs.pypass.Opened by an agent session, not the founder.
🤖 Generated with Claude Code