FreeSkills
Knowledge wiki setup
- 418418 downloads
- 129129 likes
- 161161 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
Evaluating LLMs on academic benchmarks v1.0.0
Use this resource to evaluate and compare language models on academic benchmarks
New
- 355 downloads
- 162 likes
- 187 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install llm-benchmark-evaluation-harnessWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent prepares lm-evaluation-harness commands for a Hugging Face model, vLLM or an API, picks the tasks and tracks scores across training. You get the commands, loaded results and a model comparison.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- MIT
Similar resources
View all- Free
FreeSkills
Wiki health check
- 552552 downloads
- 202202 likes
- 127127 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Ask your wiki
- 374374 downloads
- 131131 likes
- 214214 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki source ingestion
- 315315 downloads
- 230230 likes
- 246246 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki auditor agent
- 556556 downloads
- 205205 likes
- 192192 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
UX research assistant
- 598598 downloads
- 142142 likes
- 236236 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki ingestion agent
- 437437 downloads
- 162162 likes
- 191191 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki librarian agent
- 304304 downloads
- 120120 likes
- 217217 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md: installation, standard evaluation workflows and training progress tracking
- references/benchmark-guide.md: guide to available benchmarks
- references/custom-tasks.md, references/api-evaluation.md and references/distributed-eval.md: custom tasks, APIs and distributed evaluation
Good fit for
- You need to publish academic scores for a model
- You compare several checkpoints or models on the same tasks
Not for
Tags
- benchmark
- evaluation
- llm
- mmlu
About
You say
“Evaluate this model on MMLU, GSM8K and HellaSwag, then compare it with the previous checkpoint.”
Skill published by davila7 under the MIT license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to evaluate and compare language models on academic benchmarks
- Review and adjust the result
Content preview
Files
- LICENSE1.1 KB
- NOTICE-PALATEKIT.md0.5 KB
- references/api-evaluation.md11.3 KB
- references/benchmark-guide.md11 KB
- references/custom-tasks.md13.4 KB
- references/distributed-eval.md11.7 KB
- SKILL.md12.1 KB
Origin and licence
Listed unmodified
- Author
- davila7
- Source
- github.com/davila7/claude-code-templates/tree/f57964ebda91cdfb31755661ecea9395f30020f1/cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness
- Licence
- MIT
Notice
« evaluation-lm-evaluation-harness » (davila7, MIT) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…