FreeSkills
Commits, branches and sync with the but CLI
- 361361 downloads
- 198198 likes
- 103103 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
Run a GGUF model locally with llama.cpp v1.0.0
Use this resource to run a GGUF model locally with llama.cpp
New
- 443 downloads
- 197 likes
- 145 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install local-gguf-inference-llamacppWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent finds the right GGUF file in a Hugging Face repo, chooses the quantization variant for your hardware, then builds the llama-server or llama-cli command. You get a ready-to-run command and a check of the OpenAI-compatible server.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- MIT
Similar resources
View all- Free
FreeSkills
Sentry CLI guide
- 525525 downloads
- 117117 likes
- 128128 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Drizzle ORM best practices with PostgreSQL
- 407407 downloads
- 194194 likes
- 151151 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
SLO design wizard
- 537537 downloads
- 105105 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
User stories and sprint fit
- 451451 downloads
- 150150 likes
- 132132 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Capacity-based sprint plan
- 423423 downloads
- 192192 likes
- 102102 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Startup CTO advisor
- 580580 downloads
- 201201 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Creating GitHub pull requests with quality checks
- 427427 downloads
- 230230 likes
- 196196 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md: model discovery, installation and quick start
- references/: server, quantization, optimisation, Hub and troubleshooting
Good fit for
- You want a local model on a computer without a dedicated GPU
- You are looking for the Q4 or Q5 quantization that fits your memory
Not for
Tags
- llama.cpp
- gguf
- quantization
- local inference
- hugging face
About
You say
“Find the Q4 GGUF of an 8B model for 16 GB of RAM and give me the llama-server command.”
Skill published by Orchestra Research under the MIT license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to run a GGUF model locally with llama.cpp
- Review and adjust the result
Content preview
Files
- LICENSE1 KB
- NOTICE-PALATEKIT.md0.5 KB
- references/advanced-usage.md10.6 KB
- references/hub-discovery.md5 KB
- references/optimization.md1.6 KB
- references/quantization.md5.8 KB
- references/server.md2.8 KB
- references/troubleshooting.md8.7 KB
- SKILL.md8.7 KB
Origin and licence
Listed unmodified
- Author
- Orchestra Research
- Source
- github.com/nousresearch/hermes-agent/tree/0c74cc682dc81bf78b78a1737b3ee77a820ccb79/optional-skills/mlops/inference/llama-cpp
- Licence
- MIT
Notice
« llama-cpp » (Orchestra Research, MIT) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…