Agent Skills: count-dataset-tokens

Guidance for counting tokens in datasets, particularly from HuggingFace or similar sources. This skill should be used when tasks involve counting tokens in datasets, understanding dataset schemas, filtering by categories/domains, or working with tokenizers. It helps avoid common pitfalls like incomplete field identification and ambiguous terminology interpretation.

UncategorizedID: benchflow-ai/skillsbench/count-dataset-tokens

Install this agent skill to your local

pnpm dlx add-skill https://github.com/benchflow-ai/skillsbench/count-dataset-tokens

Skill Files

Browse the full folder contents for count-dataset-tokens.

Download Skill

Loading file tree…

Select a file to preview its contents.