FreeSkills
Knowledge wiki setup
- 418418 downloads
- 129129 likes
- 161161 saves
Works with
- Claude Code
- Codex
- Cursor
- and 3 more
Crawl a website and save its pages as markdown v1.0.0
Use this resource to crawl a website and extract content from many pages
New
- 300 downloads
- 190 likes
- 163 saves
Free
Install with the CLI
In a terminal, from the folder you want:
npx --yes palatekit@latest install tavily-website-crawl-markdownWith no option, the skill goes to ~/.agents/skills/; add --agent claude-code (or codex, cursor…) to target an agent.
First time: connect the CLI with
npx --yes palatekit@latest loginThe agent runs a crawl bounded by depth, breadth and path, then extracts the content of each page, with an optional semantic filter. You get the text, or one markdown file per page saved on your machine.
Mostly picked by
Updated November 2, 2026
Previews
Details
- Install guides
- Generates with
- Your agent's model
- Licence
- MIT
Similar resources
View all- Free
FreeSkills
Wiki health check
- 552552 downloads
- 202202 likes
- 127127 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Ask your wiki
- 374374 downloads
- 131131 likes
- 214214 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki source ingestion
- 315315 downloads
- 230230 likes
- 246246 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki auditor agent
- 556556 downloads
- 205205 likes
- 192192 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
UX research assistant
- 598598 downloads
- 142142 likes
- 236236 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki ingestion agent
- 437437 downloads
- 162162 likes
- 191191 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
FreeSkills
Wiki librarian agent
- 304304 downloads
- 120120 likes
- 217217 saves
Works with- Claude Code
- Codex
- Cursor
- and 3 more
What you get
- SKILL.md: depth, limit and path-filter options
- SKILL.md: saving each page as a markdown file
Good fit for
- You want to download a tool's documentation as markdown
- You need to extract a whole section of a site for analysis
Not for
Tags
- crawl
- markdown
- documentation
- extraction
- tavily
About
You say
“Crawl the /docs section of this site and save each page as markdown.”
Skill published by tavily-ai under the MIT license, delivered in its original version.
Show moreShow less
How to use it
- Install the skill in your agent's skills folder
- Ask your agent to crawl a website and extract content from many pages
- Review and adjust the result
Content preview
Files
- LICENSE1.1 KB
- NOTICE-PALATEKIT.md0.5 KB
- SKILL.md4.5 KB
Origin and licence
Listed unmodified
- Author
- tavily-ai
- Source
- github.com/tavily-ai/skills/tree/778122e5f9c680f541eeceda5a5b36405eb7980c/skills/tavily-crawl
- Licence
- MIT
Notice
« tavily-crawl » (tavily-ai, MIT) livré dans sa version d'origine : fiche en français et en anglais par PalateKit.
User reviews
–
No ratings yet
Loading reviews…