Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
5,629 workflow runs
5,629 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

fix extra_match low if batch_size > 1 Tasks Modified #3935: Pull request #2595 opened by sywangyi
December 24, 2024 11:19 16s sywangyi:acc_fix
sywangyi:acc_fix
December 24, 2024 11:19 16s
AraDICE task config file Unit Tests #3906: Pull request #2507 synchronize by firojalam
December 24, 2024 09:30 6m 27s firojalam:AraDiCE
firojalam:AraDiCE
December 24, 2024 09:30 6m 27s
AraDICE task config file Tasks Modified #3934: Pull request #2507 synchronize by firojalam
December 24, 2024 09:30 4m 41s firojalam:AraDiCE
firojalam:AraDiCE
December 24, 2024 09:30 4m 41s
change to single process for bootstrap_stderr Unit Tests #3905: Pull request #2593 opened by zhuyuhua-v
December 23, 2024 10:00 5m 55s zhuyuhua-v:yuhua/single-process-stderr
zhuyuhua-v:yuhua/single-process-stderr
December 23, 2024 10:00 5m 55s
change to single process for bootstrap_stderr Tasks Modified #3933: Pull request #2593 opened by zhuyuhua-v
December 23, 2024 10:00 1m 43s zhuyuhua-v:yuhua/single-process-stderr
zhuyuhua-v:yuhua/single-process-stderr
December 23, 2024 10:00 1m 43s
AraDICE task config file Unit Tests #3904: Pull request #2507 synchronize by firojalam
December 21, 2024 15:49 6m 16s firojalam:AraDiCE
firojalam:AraDiCE
December 21, 2024 15:49 6m 16s
AraDICE task config file Tasks Modified #3932: Pull request #2507 synchronize by firojalam
December 21, 2024 15:49 9m 19s firojalam:AraDiCE
firojalam:AraDiCE
December 21, 2024 15:49 9m 19s
Wandb step handling bugfix and feature (#2580) Tasks Modified #3931: Commit b86aa21 pushed by baberabb
December 20, 2024 21:40 11s main
main
December 20, 2024 21:40 11s
Wandb step handling bugfix and feature (#2580) Unit Tests #3903: Commit b86aa21 pushed by baberabb
December 20, 2024 21:40 5m 55s main
main
December 20, 2024 21:40 5m 55s
Update dependencies in pyproject.toml: remove duplicated 'evaluate', add 'anthropic' and 'openai' to optional dependencies Tasks Modified #3930: Pull request #2582 synchronize by Technolog796
December 20, 2024 09:58 Action required Technolog796:main
Technolog796:main
December 20, 2024 09:58 Action required
Update dependencies in pyproject.toml: remove duplicated 'evaluate', add 'anthropic' and 'openai' to optional dependencies Unit Tests #3902: Pull request #2582 synchronize by Technolog796
December 20, 2024 09:58 Action required Technolog796:main
Technolog796:main
December 20, 2024 09:58 Action required
Update dependencies in pyproject.toml: remove duplicated 'evaluate', add 'anthropic' and 'openai' to optional dependencies Unit Tests #3901: Pull request #2582 synchronize by Technolog796
December 20, 2024 08:40 Action required Technolog796:main
Technolog796:main
December 20, 2024 08:40 Action required
Update dependencies in pyproject.toml: remove duplicated 'evaluate', add 'anthropic' and 'openai' to optional dependencies Tasks Modified #3929: Pull request #2582 synchronize by Technolog796
December 20, 2024 08:40 Action required Technolog796:main
Technolog796:main
December 20, 2024 08:40 Action required
Fix the format of mgsm zh and ja. Tasks Modified #3928: Pull request #2587 opened by timturing
December 20, 2024 04:10 1m 45s timturing:main
timturing:main
December 20, 2024 04:10 1m 45s
Fix the format of mgsm zh and ja. Unit Tests #3900: Pull request #2587 opened by timturing
December 20, 2024 04:10 5m 45s timturing:main
timturing:main
December 20, 2024 04:10 5m 45s
Wandb step handling bugfix and feature Unit Tests #3899: Pull request #2580 synchronize by sjmielke
December 19, 2024 23:06 5m 49s sjmielke:main
sjmielke:main
December 19, 2024 23:06 5m 49s
Wandb step handling bugfix and feature Tasks Modified #3927: Pull request #2580 synchronize by sjmielke
December 19, 2024 23:06 18s sjmielke:main
sjmielke:main
December 19, 2024 23:06 18s
add warning for truncation (#2585) Tasks Modified #3926: Commit 6ccd520 pushed by baberabb
December 19, 2024 21:58 11s main
main
December 19, 2024 21:58 11s
add warning for truncation (#2585) Unit Tests #3898: Commit 6ccd520 pushed by baberabb
December 19, 2024 21:58 5m 40s main
main
December 19, 2024 21:58 5m 40s
add warning for truncation Unit Tests #3897: Pull request #2585 synchronize by baberabb
December 19, 2024 21:51 5m 54s maxlenwarning
maxlenwarning
December 19, 2024 21:51 5m 54s
add warning for truncation Tasks Modified #3925: Pull request #2585 synchronize by baberabb
December 19, 2024 21:51 12s maxlenwarning
maxlenwarning
December 19, 2024 21:51 12s
add warning for truncation Tasks Modified #3924: Pull request #2585 opened by baberabb
December 19, 2024 21:51 12s maxlenwarning
maxlenwarning
December 19, 2024 21:51 12s
add warning for truncation Unit Tests #3896: Pull request #2585 opened by baberabb
December 19, 2024 21:51 6m 25s maxlenwarning
maxlenwarning
December 19, 2024 21:51 6m 25s
Add Global MMLU Lite (#2567) Tasks Modified #3923: Commit 2b75b11 pushed by baberabb
December 19, 2024 14:54 1m 56s main
main
December 19, 2024 14:54 1m 56s
Add Global MMLU Lite (#2567) Unit Tests #3895: Commit 2b75b11 pushed by baberabb
December 19, 2024 14:54 6m 25s main
main
December 19, 2024 14:54 6m 25s