This change adds a dedicated daily evaluation module so teams can benchmark browser-agent runs in a repeatable, task-card-driven way instead of using ad-hoc scripts, making quality drift easier to detect over time.
Scattered source updates, isolated context, and manual follow-up across multiple feeds.
Introduces a concrete, reusable evaluation harness for browser-use by adding a standalone experiment module plus CLI orchestration (`init`, `run-agent`, `compare`) that executes predefined task cards, supports multiple model backends/presets, and produces comparable result artifacts.
Evaluation operators and model teams can now run the same daily browser-agent tasks through one CLI workflow and compare human-vs-agent outcomes side by side, so regressions in automation quality become easier to detect before they spread into broader evaluation or deployment workflows; the next thing to watch is whether score variance stays stable across repeated runs and provider backends. The pull request adds a self-contained `browser_use/experiments/daily_task_eval` package with `A/B/C/D` presets, navigator options (including periodic replanning), and structured JSON/CSV outputs (`history`, `conversation`, summaries), but this should still be monitored for noise from replan timing and preset/provider defaults that could skew trend interpretation.
Evaluation operators and model teams can now run the same daily browser-agent tasks through one CLI workflow and compare human-vs-agent outcomes side by side, so regressions in automation quality become easier to detect before they spread into broader evaluation or deployment workflows; the next thing to watch is whether score variance stays stable across repeated runs and provider backends. The pull request adds a self-contained `browser_use/experiments/daily_task_eval` package with `A/B/C/D` presets, navigator options (including periodic replanning), and structured JSON/CSV outputs (`history`, `conversation`, summaries), but this should still be monitored for noise from replan timing and preset/provider defaults that could skew trend interpretation.