FreeSkills
Commits, branches and sync with the but CLI
- 361361 downloads
- 198198 likes
- 103103 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
Choosing a distributed training strategy v1.0.0
Use this resource to choose and configure the distributed parallelism strategy in NeMo AutoModel
New
- 332 downloads
- 198 likes
- 155 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install distributed-training-strategy-automodelWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent picks the strategy first, then names only the YAML fields and constraints relevant to the question, with examples for FSDP2, TP plus PP on a large multi-node model, or MoE expert parallelism. You get a configuration that respects the Megatron FSDP limits.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- Apache-2.0
Similar resources
View all- Free
FreeSkills
Sentry CLI guide
- 525525 downloads
- 117117 likes
- 128128 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Drizzle ORM best practices with PostgreSQL
- 407407 downloads
- 194194 likes
- 151151 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
SLO design wizard
- 537537 downloads
- 105105 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
User stories and sprint fit
- 451451 downloads
- 150150 likes
- 132132 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Capacity-based sprint plan
- 423423 downloads
- 192192 likes
- 102102 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Startup CTO advisor
- 580580 downloads
- 201201 likes
- 242242 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Creating GitHub pull requests with quality checks
- 427427 downloads
- 230230 likes
- 196196 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md: strategies and examples
- evals/evals.json: evaluation cases
- skill-card.md: skill card
Good fit for
- You move from one GPU to several nodes in AutoModel
- You are unsure whether to use FSDP2 or Megatron FSDP
Not for
Tags
- distributed
- FSDP2
- parallelism
- AutoModel
About
You say
“Which distributed strategy for a 30B MoE on 2 nodes of 8 GPUs in AutoModel?”
Skill published by nvidia under the Apache-2.0 license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to choose and configure the distributed parallelism strategy in NeMo AutoModel
- Review and adjust the result
Content preview
Files
- BENCHMARK.md4.6 KB
- evals/evals.json3.3 KB
- LICENSE11.3 KB
- NOTICE-PALATEKIT.md0.5 KB
- skill-card.md4.1 KB
- SKILL.md19.4 KB
- skill.oms.sig4.5 KB
Origin and licence
Listed unmodified
- Author
- nvidia
- Source
- github.com/nvidia/skills/tree/ca116d60beafe1b4459f0ab790b7b450912c56b0/skills/nemo-automodel-distributed-training
- Licence
- Apache-2.0
Notice
« nemo-automodel-distributed-training » (nvidia, Apache-2.0) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…