Skip to content

Pull requests: eval-protocol/python-sdk

New pull request New
34 Open 354 Closed
34 Open 354 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Klavis Sandbox on Fireworks EP
#388 opened Dec 25, 2025 by zihaolin96 Loading…
1
enforce single evaluator upload per command
#387 opened Dec 24, 2025 by benjibc Loading…
3
updated tests
#382 opened Dec 18, 2025 by shreymodi1 Loading…
1
Trail proxy setup
#380 opened Dec 17, 2025 by xiaoyifan Loading…
1
Refactor ep upload to use Fireworks SDK + Auto-generate flags
#379 opened Dec 16, 2025 by dphuang2 Loading…
6
Add GEVal logprob artifacts for OpenAI and Fireworks codex
#376 opened Dec 16, 2025 by benjibc Loading…
support extra headers
#373 opened Dec 15, 2025 by benjibc Loading…
4
warn if large datasets + force 1 run
#365 opened Dec 12, 2025 by xzrderek Loading…
Shrey/modelquality
#353 opened Dec 2, 2025 by shreymodi1 Loading…
18 tasks
1
support for tokenids logprobs
#350 opened Nov 26, 2025 by shreymodi1 Loading…
18 tasks
calibration evaluator
#345 opened Nov 24, 2025 by benjibc • Draft
18 tasks
adding response quality validation for retry
#344 opened Nov 24, 2025 by morgendave Loading…
10 tasks
6
tests fix
#341 opened Nov 21, 2025 by shreymodi1 Loading…
18 tasks
5
Shrey/trl
#335 opened Nov 17, 2025 by shreymodi1 Loading…
18 tasks
1
Update Klavis MCP use case
#330 opened Nov 14, 2025 by LLiuZheng Loading…
1
Text to SQL RFT example
#324 opened Nov 10, 2025 by benjibc Loading…
6
swe-bench
#280 opened Oct 15, 2025 by shreymodi1 Loading…
42
reasoning effort string change
#267 opened Oct 10, 2025 by shreymodi1 Loading…
18 tasks
1
reuse pydantic example for local model picking
#251 opened Oct 5, 2025 by benjibc Loading…
pyyaml removal step 1
#247 opened Oct 3, 2025 by benjibc Loading…
directly hit enter to select
#245 opened Oct 2, 2025 by benjibc Loading…
2
auto convert from dict
#239 opened Sep 30, 2025 by mayinghan Loading…
18 tasks
Add local Langfuse LiteLLM aha judge example codex
#230 opened Sep 27, 2025 by benjibc • Draft
Route benchmark datasets through data loaders codex
#229 opened Sep 27, 2025 by benjibc Loading…
docs: add tracing integration contribution guide codex
#201 opened Sep 22, 2025 by benjibc Loading…
ProTip! Exclude everything labeled bug with -label:bug.