Back to directory
Frontendyour-org/crawler-scraper
crawler-scraper
Production-grade, highly scalable web crawler and scraper with HTTP + browser fetching, Markdown extraction, CLI and HTTP API.
Suggested install command
npx skills add your-org/crawler-scraper/crawler-scraperAlways inspect the linked repository and skill instructions before running commands. Skills are instructions; permissions and execution still matter.
Compatibility
Agent support matrix
3 supported
| Agent | Status |
|---|---|
| Claude Code | Supported |
| OpenCode | Not listed |
| Cursor | Supported |
| MCP | Not listed |
| GitHub Copilot | Not listed |
| Windsurf |