Search results

Start updating runs.jsonl again

Status: Open.

#42 In METR/eval-analysis-public;

· BoxoMcFoxo opened on Jul 4, 2026

Suggestion: measure multi-session coherence, not just single-session endurance

Status: Open.

#40 In METR/eval-analysis-public;

· immartian opened on Apr 12, 2026

The 'histograms' aren't actually histograms

Status: Open.

#37 In METR/eval-analysis-public;

· dfilan opened on Feb 26, 2026

How are you counting the time?

Status: Open.

#35 In METR/eval-analysis-public;

· gianpaj opened on Feb 5, 2026

Grok 4, Sonnet-4 and new run updates

Status: Open.

#27 In METR/eval-analysis-public;

· crizCraig opened on Aug 3, 2025

Add a license so people are allowed to run and reuse the code

Status: Open.

#26 In METR/eval-analysis-public;

· StefKirsch opened on Apr 30, 2025

Switch from poetry to uv

Status: Open.

#16 In METR/eval-analysis-public;

· naterush opened on Feb 1, 2025

Remove torch as a dependency?

Status: Open.

#15 In METR/eval-analysis-public;

· naterush opened on Feb 1, 2025

Delete the data/wrangled folder

Status: Open.

#14 In METR/eval-analysis-public;

· naterush opened on Jan 27, 2025

dvc pull fails on this repo

Status: Open.

#12 In METR/eval-analysis-public;

· naterush opened on Jan 25, 2025