Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
braintrustdata
/
autoevals
Public
Notifications
You must be signed in to change notification settings
Fork
83
Star
1k
Code
Issues
11
Pull requests
20
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Actions: braintrustdata/autoevals
Actions
All workflows
Workflows
publish
publish
Copilot
Copilot
Copilot code review
Copilot code review
Dependabot Updates
Dependabot Updates
Dependency Graph
Dependency Graph
Enforce pnpm
Enforce pnpm
js
js
lint
lint
python
python
Run pnpm evals
Run pnpm evals
Show more workflows...
Management
Caches
Deployments
python
python
Actions
Loading...
Loading
Sorry, something went wrong.
Uh oh!
There was an error while loading.
Please reload this page
.
will be ignored since log searching is not yet available
Show workflow options
Create status badge
Create status badge
Loading
Uh oh!
There was an error while loading.
Please reload this page
.
python.yaml
will be ignored since log searching is not yet available
242 workflow runs
242 workflow runs
Event
Filter by Event
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching events.
Status
Filter by Status
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching statuses.
Branch
Filter by Branch
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching branches.
Actor
Filter by Actor
Sorry, something went wrong.
Filter
Loading
Sorry, something went wrong.
No matching users.
Add configurable default model support
python
#560:
Pull request
#161
synchronize by
Qard
1m 21s
model-flexibility
model-flexibility
1m 21s
View #161
View workflow file
Improve parameter flexibility
python
#559:
Pull request
#160
synchronize by
Qard
1m 50s
parameter-flexibility
parameter-flexibility
1m 50s
View #160
View workflow file
Add configurable default model support
python
#558:
Pull request
#161
synchronize by
Qard
1m 27s
model-flexibility
model-flexibility
1m 27s
View #161
View workflow file
Add configurable default model support
python
#557:
Pull request
#161
synchronize by
Qard
1m 30s
model-flexibility
model-flexibility
1m 30s
View #161
View workflow file
Allow setting embedding model in AnswerCorrectness
python
#556:
Pull request
#162
opened by
Qard
1m 39s
configurable-answer-correctness-embedding-model
configurable-answer-correctness-embedding-model
1m 39s
View #162
View workflow file
Add configurable default model support
python
#555:
Pull request
#161
synchronize by
Qard
1m 43s
model-flexibility
model-flexibility
1m 43s
View #161
View workflow file
Add configurable default model support
python
#554:
Pull request
#161
synchronize by
Qard
1m 49s
model-flexibility
model-flexibility
1m 49s
View #161
View workflow file
Add configurable default model support
python
#553:
Pull request
#161
synchronize by
Qard
1m 55s
model-flexibility
model-flexibility
1m 55s
View #161
View workflow file
Add configurable default model support
python
#552:
Pull request
#161
synchronize by
Qard
1m 34s
model-flexibility
model-flexibility
1m 34s
View #161
View workflow file
Add configurable default model support
python
#551:
Pull request
#161
opened by
Qard
1m 35s
model-flexibility
model-flexibility
1m 35s
View #161
View workflow file
Fix ContextRelevancy score
python
#550:
Pull request
#159
synchronize by
Qard
1m 30s
fix-context-relevancy-scoring
fix-context-relevancy-scoring
1m 30s
View #159
View workflow file
Improve parameter flexibility
python
#549:
Pull request
#160
opened by
Qard
1m 43s
parameter-flexibility
parameter-flexibility
1m 43s
View #160
View workflow file
Fix ContextRelevancy score
python
#548:
Pull request
#159
synchronize by
Qard
1m 47s
fix-context-relevancy-scoring
fix-context-relevancy-scoring
1m 47s
View #159
View workflow file
Fix ContextRelevancy score
python
#547:
Pull request
#159
opened by
Qard
1m 45s
fix-context-relevancy-scoring
fix-context-relevancy-scoring
1m 45s
View #159
View workflow file
Fix CJS dependency issue
python
#546:
Pull request
#158
opened by
Qard
1m 40s
fix-cjs-deps
fix-cjs-deps
1m 40s
View #158
View workflow file
Allow autoevals to support both zod 3 and zod 4
python
#545:
Pull request
#155
synchronize by
cpinn
1m 25s
caitlin/update-zod4
caitlin/update-zod4
1m 25s
View #155
View workflow file
Allow autoevals to support both zod 3 and zod 4
python
#544:
Pull request
#155
synchronize by
cpinn
1m 29s
caitlin/update-zod4
caitlin/update-zod4
1m 29s
View #155
View workflow file
Allow autoevals to support both zod 3 and zod 4
python
#543:
Pull request
#155
synchronize by
cpinn
1m 34s
caitlin/update-zod4
caitlin/update-zod4
1m 34s
View #155
View workflow file
Python 3.10 min. (#154)
python
#542:
Commit
87dfbcd
pushed by
ibolmo
1m 29s
main
main
1m 29s
View workflow file
Allow autoevals to support both zod 3 and zod 4
python
#541:
Pull request
#155
synchronize by
cpinn
1m 34s
caitlin/update-zod4
caitlin/update-zod4
1m 34s
View #155
View workflow file
Allow autoevals to support both zod 3 and zod 4
python
#540:
Pull request
#155
synchronize by
cpinn
1m 30s
caitlin/update-zod4
caitlin/update-zod4
1m 30s
View #155
View workflow file
Python 3.10 min.
python
#539:
Pull request
#154
synchronize by
ibolmo
1m 23s
python-3.10
python-3.10
1m 23s
View #154
View workflow file
pnpm 10 (#156)
python
#538:
Commit
1c35c0a
pushed by
ibolmo
1m 40s
main
main
1m 40s
View workflow file
pnpm 10
python
#537:
Pull request
#156
synchronize by
ibolmo
1m 28s
pnpm-10
pnpm-10
1m 28s
View #156
View workflow file
pnpm 10
python
#536:
Pull request
#156
synchronize by
ibolmo
1m 28s
pnpm-10
pnpm-10
1m 28s
View #156
View workflow file
Previous
1
2
…
6
7
8
9
10
Next
You can’t perform that action at this time.