Agent Skills: incremental-fetch
Build resilient data ingestion pipelines from APIs. Use when creating scripts that fetch paginated data from external APIs (Twitter, exchanges, any REST API) and need to track progress, avoid duplicates, handle rate limits, and support both incremental updates and historical backfills. Triggers: 'ingest data from API', 'pull tweets', 'fetch historical data', 'sync from X', 'build a data pipeline', 'fetch without re-downloading', 'resume the download', 'backfill older data'. NOT for: simple one-shot API calls, websocket/streaming connections, file downloads, or APIs without pagination.
UncategorizedID: rohunvora/cool-claude-skills/incremental-fetch
201
Install this agent skill to your local
Skill Files
Browse the full folder contents for incremental-fetch.
Loading file tree…
Select a file to preview its contents.