Agent-Skills.md

Agent Skills: Content Crawler Protocol

High-speed read-only web extraction. Use when fetching documentation, blogs, and static pages. Do not use for apps requiring login or interaction.

UncategorizedID: Git-Fg/thecattoolkit/crawling-content

Repository

Git-Fg/thecattoolkit
Git-FgLicense: MIT
1

Install this agent skill to your local

pnpm dlx add-skill https://github.com/Git-Fg/thecattoolkit/tree/HEAD/plugins/sys-browser/skills/crawling-content

Skill Files

Browse the full folder contents for crawling-content.

Download Skill

Loading file tree…

plugins/sys-browser/skills/crawling-content/SKILL.md

Skill Metadata

Name
crawling-content
Description
"High-speed read-only web extraction. Use when fetching documentation, blogs, and static pages. Do not use for apps requiring login or interaction."

Content Crawler Protocol

Usage

Use @just-every/crawl for zero-latency markdown extraction.

Single Page (Read)

npx -y @just-every/crawl "https://example.com"

Site Map (Spider)

npx -y @just-every/crawl "https://example.com" --pages 20 --output json

Failure Mode

If output contains "JavaScript required" or "Access Denied", STOP. Switch to Skill(browsing-web) to handle the dynamic rendering.