FreeSkills
Knowledge wiki setup
- 418418 downloads
- 129129 likes
- 161161 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
LLM evaluation across 100+ benchmarks with NeMo v1.0.0
Use this resource to evaluate an LLM on many benchmarks in a reproducible, scalable way
New
- 521 downloads
- 102 likes
- 173 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install llm-benchmark-nemo-evaluatorWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent writes the NeMo evaluation configuration, picks an execution backend (local Docker, Slurm or cloud), runs benchmarks on a sample or in full, then tracks job status and retrieves results. You get a reproducible evaluation.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- MIT
Similar resources
View all- Free
FreeSkills
Wiki health check
- 552552 downloads
- 202202 likes
- 127127 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Ask your wiki
- 374374 downloads
- 131131 likes
- 214214 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki source ingestion
- 315315 downloads
- 230230 likes
- 246246 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki auditor agent
- 556556 downloads
- 205205 likes
- 192192 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
UX research assistant
- 598598 downloads
- 142142 likes
- 236236 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki ingestion agent
- 437437 downloads
- 162162 likes
- 191191 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki librarian agent
- 304304 downloads
- 120120 likes
- 217217 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md: minimal configuration, execution and job tracking
- references/execution-backends.md: running on local Docker, Slurm or cloud
- references/custom-benchmarks.md: adding custom benchmarks
Good fit for
- You compare a model against others on standard benchmarks
- You need to run an evaluation on a Slurm cluster
Not for
Tags
- evaluation
- benchmark
- llm
About
You say
“Evaluate this model on MMLU and GSM8K through an API endpoint, running Docker locally.”
Skill published by Orchestra Research under the MIT license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to evaluate an LLM on many benchmarks in a reproducible, scalable way
- Review and adjust the result
Content preview
Files
- LICENSE1.1 KB
- NOTICE-PALATEKIT.md0.5 KB
- references/adapter-system.md9.6 KB
- references/configuration.md9.8 KB
- references/custom-benchmarks.md7.2 KB
- references/execution-backends.md9.5 KB
- SKILL.md12.4 KB
Origin and licence
Listed unmodified
- Author
- Orchestra Research
- Source
- github.com/davila7/claude-code-templates/tree/f57964ebda91cdfb31755661ecea9395f30020f1/cli-tool/components/skills/ai-research/evaluation-nemo-evaluator
- Licence
- MIT
Notice
« evaluation-nemo-evaluator » (Orchestra Research, MIT) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…