evaluation-lm-evaluation-harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
[EvaluationLMEvaluationHarness
Orchestra Research
33,1943,891
arxiv
Search arXiv papers by keyword, author, category, or ID.
[ResearchArxivPapersAcademic
delorenj
176
evaluating-llms-harness
lm-eval-harness: benchmark LLMs (MMLU, GSM8K, etc.).
[EvaluationLMEvaluationHarness
delorenj
176
evaluating-llms-harness
lm-eval-harness: benchmark LLMs (MMLU, GSM8K, etc.).
[EvaluationLMEvaluationHarness
poorrican
0
arxiv
Search arXiv papers by keyword, author, category, or ID.
[ResearchArxivPapersAcademic
poorrican
0
evaluating-llms-harness
lm-eval-harness: benchmark LLMs (MMLU, GSM8K, etc.).
[EvaluationLMEvaluationHarness
PoorRican
0
arxiv
Search arXiv papers by keyword, author, category, or ID.
[ResearchArxivPapersAcademic
PoorRican
0