FreeSkills
Commits, branches and sync with the but CLI
- 361361 downloads
- 198198 likes
- 103103 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
Benchmark RAG answer quality on files v1.0.0
Use this resource to measure answer quality of a RAG pipeline from a file corpus
New
- 373 downloads
- 107 likes
- 231 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install rag-quality-benchmark-evalWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent guides you through preparing the corpus/ folder and train.json, running the RAGAS evaluation script and reading the JSON results. It also pinpoints failure causes such as HTTP or stream errors, empty contexts, collection mismatch or judge API errors.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- Apache-2.0
Similar resources
View all- Free
FreeSkills
Sentry CLI guide
- 525525 downloads
- 117117 likes
- 128128 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Drizzle ORM best practices with PostgreSQL
- 407407 downloads
- 194194 likes
- 151151 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
SLO design wizard
- 537537 downloads
- 105105 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
User stories and sprint fit
- 451451 downloads
- 150150 likes
- 132132 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Capacity-based sprint plan
- 423423 downloads
- 192192 likes
- 102102 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Startup CTO advisor
- 580580 downloads
- 201201 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Creating GitHub pull requests with quality checks
- 427427 downloads
- 230230 likes
- 196196 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md : method and evaluation rules
- references/evaluate-rag-cli.md : evaluation script options
- references/result-analysis.md : reading the results
Good fit for
- You compare two retrieval settings on answer quality
- The RAGAS score drops and you need the cause
Not for
Tags
- rag
- evaluation
- ragas
- benchmark
- corpus
About
You say
“Evaluate my RAG's answer quality on the corpus in this folder with RAGAS.”
Skill published by nvidia under the Apache-2.0 license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to measure answer quality of a RAG pipeline from a file corpus
- Review and adjust the result
Content preview
Files
- BENCHMARK.md2.9 KB
- eval/h100.json2.9 KB
- eval/nvidia_hosted.json1.9 KB
- LICENSE11.3 KB
- NOTICE-PALATEKIT.md0.4 KB
- references/benchmark-execution.md8.3 KB
- references/dataset-and-conversion.md8.3 KB
- references/evaluate-rag-cli.md4.3 KB
- references/result-analysis.md2.9 KB
- skill-card.md2.7 KB
- SKILL.md9.3 KB
- skill.oms.sig5.7 KB
Origin and licence
Listed unmodified
- Author
- nvidia
- Source
- github.com/nvidia/skills/tree/ca116d60beafe1b4459f0ab790b7b450912c56b0/skills/rag-eval
- Licence
- Apache-2.0
Notice
« rag-eval » (nvidia, Apache-2.0) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…