Agent-Skills.md

Agent Skills: Web Scraper Tool

从网页提取和处理数据，使用CSS选择器、XPath智能解析，支持限速和错误处理。

UncategorizedID: aidotnet/moyucode/web-scraper

Repository

aidotnet/moyucode
AIDotNetLicense: MIT
7614

Install this agent skill to your local

pnpm dlx add-skill https://github.com/AIDotNet/MoYuCode/tree/HEAD/skills/tools/web-scraper

Skill Files

Browse the full folder contents for web-scraper.

Download Skill

Loading file tree…

skills/tools/web-scraper/SKILL.md

Skill Metadata

Name
web-scraper
Description
使用CSS选择器从网页提取数据，支持分页、限速和多种输出格式。

Web Scraper Tool

Description

Extract structured data from web pages using CSS selectors with rate limiting and pagination support.

Trigger

  • /scrape command
  • User requests web data extraction
  • User needs to parse HTML

Usage

# Scrape single page
python scripts/web_scraper.py --url "https://example.com" --selector ".item" --output data.json

# Scrape with multiple selectors
python scripts/web_scraper.py --url "https://example.com" --selectors "title:.title,price:.price,link:a@href"

# Scrape multiple pages
python scripts/web_scraper.py --urls urls.txt --selector ".product" --output products.json --delay 2

Tags

scraping, web, html, data-extraction, automation

Compatibility

  • Codex: ✅
  • Claude Code: ✅
Web Scraper Tool Skill | Agent Skills