Repository navigation
docs: browser-use 1.0 judges every run (result.judgement, judge, judge_context) - #421
mathisdittrich wants to merge 8 commits into
Conversation
…e_context) Source: browser-use/browser-use#6398. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Automations to automatically generate PRs for you. |
There was a problem hiding this comment.
All reported issues were addressed across 5 files
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… case Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
There was a problem hiding this comment.
All reported issues were addressed across 1 file (changes from recent commits).
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
…ss (browser-use#6403) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
There was a problem hiding this comment.
All reported issues were addressed across 2 files (changes from recent commits).
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
There was a problem hiding this comment.
All reported issues were addressed across 2 files (changes from recent commits).
Reply with feedback, questions, or to request a fix.
View guided diff | Turn on auto-fix | Re-trigger cubic
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
browser-use/browser-use#6398 (merged 2026-11-14) brings the judge back in the open-source library: after each run that took a step, one low-effort request to the agent's own model fills
result.judgement(plus one text-only retry if the model rejects the images with an HTTP 4xx, per #6403). The open-source docs still said the judge was removed (use_judgeignored,ground_truth/judgement()→result.success).Changes, all facts from the #6398 diff (MIGRATING.md, README.md,
agent/service.py,agent/judge.py,agent/views.py,legacy.py,telemetry/):judge(defaultTrue) andjudge_context(defaultNone) rows;use_judgeremoved from the ignored list (it is now an alias, popped from kwargs, no longer inIGNORED).judgementfield,cost_usdincludes the judge, new "Judge" section with theJudgementfields.use_judge/ground_truthkept asjudge/judge_context;judge_llmdropped;judgement()is now theresult.judgementattribute;browser_use.agent.judgeJudgementResult/SimpleJudgeResultpoint toJudgement.agent_eventcarries the scrubbed judgement (schema 5), only whetherjudge_contextis set is sent as configuration; the verdict is scrubbed text, so short or partial quotes of the context can remain.judgenorjudge_context, sopip install browser-useusers would see params that do not exist yet. (Thedocs-oss-paramsCI installs browser-use from GitHub main, so it already passes.)Not documented (unsure): the exact warning text a failed judge logs, and whether the CLI/MCP server expose the judgement.
🤖 Generated with Claude Code
Summary by cubic
Updates the open-source docs to reflect that browser-use 1.0 judges every run that took a step, filling
result.judgementwith the verdict.judge(defaultTrue) andjudge_context, plusresult.judgementand its fields; gotchas are also written on success when a site rejected, errored or blocked the agent, and if the model rejects images with an HTTP 4xx error that mentionsimage, the judge retries once with text alone.use_judgeandground_truthstay as aliases,judge_llmis dropped, andjudgement()becomes theresult.judgementattribute.result.judgementNoneand never changes the run's own result.cost_usdand the scrubbed verdict in telemetry, with the 300-character caps that apply per field;judge_contextitself is never sent, though partial quotes of it can survive in the scrubbed verdict.Merge after the next browser-use release. browser-use/browser-use#6398 merged after 1.0.4, and PyPI 1.0.4 has neither
judgenorjudge_context; the parameter check CI installs from main and passes.Written for commit fc46e1d. Summary will update on new commits.