Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
UiPath
/
coder_eval
Public
Notifications
You must be signed in to change notification settings
Fork
2
Star
109
Code
Issues
3
Pull requests
20
Discussions
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Security and quality
Insights
Commits
Breadcrumbs
History for
coder_eval
src
coder_eval
models
on
main
User selector
All users
All time
Commit history
Commits on Aug 6, 2026
feat(sandbox): generate CLI recording shims via record_cli (#73)
Show description for a7ec3ea
alexandrujircan
and
claude
authored
a7ec3ea
View commit details
Copy full SHA for a7ec3ea
View code at this point
Browse repository at this point
Commits on Aug 5, 2026
fix(command-executed): match patterns against shell-normalized commands (#77)
Show description for 7abd080
rockymadden
and
claude
authored
7abd080
View commit details
Copy full SHA for 7abd080
View code at this point
Browse repository at this point
feat(criteria): add cli_called for structured invocation matching (#72)
Show description for 8574ded
alexandrujircan
and
claude
authored
8574ded
View commit details
Copy full SHA for 8574ded
View code at this point
Browse repository at this point
Commits on Aug 4, 2026
feat(early-stop)!: per-criterion arming via stop_early blocks on live criteria (#78)
Show description for 4cf8092
akshaylive
and
claude
authored
4cf8092
View commit details
Copy full SHA for 4cf8092
View code at this point
Browse repository at this point
feat(early-stop): weighted ceiling/floor bounds + decision-step budget (#74)
Show description for 800ac77
akshaylive
and
claude
authored
800ac77
View commit details
Copy full SHA for 800ac77
View code at this point
Browse repository at this point
Commits on Jul 31, 2026
feat(litellm): actual per-call cost + cache accounting for the open-weight backend (#66)
Show description for 4131a2a
CarlesUIPath
and
claude
authored
4131a2a
View commit details
Copy full SHA for 4131a2a
View code at this point
Browse repository at this point
Commits on Jul 29, 2026
fix(reports): count errors as misses and stop losing cost on error paths (#63)
Show description for 93c7fc0
bai-uipath
and
claude
authored
93c7fc0
View commit details
Copy full SHA for 93c7fc0
View code at this point
Browse repository at this point
Commits on Jul 28, 2026
feat(routing): add LiteLLM backend to run open-weight models on the Claude Code harness (#54)
Show description for 49edc89
CarlesUIPath
and
claude
authored
49edc89
View commit details
Copy full SHA for 49edc89
View code at this point
Browse repository at this point
Commits on Jul 24, 2026
fix(early-stop): add stop_when 'auto' — per-instance arming + pass-armed-subset stop rule (#51)
Show description for 08e21e6
mohsen-uipath
authored
08e21e6
View commit details
Copy full SHA for 08e21e6
View code at this point
Browse repository at this point
fix: remove dead SimulationConfig.parallel_trials; add CE031 to guard the class
Show description for 947acd3
uipreliga
and
claude
committed
947acd3
View commit details
Copy full SHA for 947acd3
View code at this point
Browse repository at this point
docs: 1/8 — add DATASETS.md and a task-schema dataset: section
Show description for e3d37ac
uipreliga
and
claude
committed
e3d37ac
View commit details
Copy full SHA for e3d37ac
View code at this point
Browse repository at this point
Commits on Jul 23, 2026
fix(early-stop): decide skill activation on the tool call, not its result (#43)
Show description for d34aa97
3 people
authored
d34aa97
View commit details
Copy full SHA for d34aa97
View code at this point
Browse repository at this point
Commits on Jul 22, 2026
fix: weight:0 un-gates criteria and renders as informational (#34)
Show description for 9a34e90
uipreliga
and
claude
authored
9a34e90
View commit details
Copy full SHA for 9a34e90
View code at this point
Browse repository at this point
Commits on Jul 13, 2026
feat(early-stop): opt-in early stop once armed criteria are decided (#14)
Show description for b0c1ade
mohsen-uipath
authored
b0c1ade
View commit details
Copy full SHA for b0c1ade
View code at this point
Browse repository at this point
Commits on Jul 9, 2026
Initial public release
uipreliga
committed
aab35e6
View commit details
Copy full SHA for aab35e6
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.