Prompt Governance
Category: Engineering Domain: AI Governance
Overview
The Prompt Governance skill provides tools for auditing prompts for security vulnerabilities, bias, and safety issues, plus managing a versioned catalog of approved prompts. Essential for organizations deploying LLM-based applications at scale.
Clarify First
Before auditing or cataloging, confirm these inputs. If any is unknown or vague, ASK — do not assume:
- [ ] Target prompt(s) — the exact file/text to audit or the catalog dir to manage (the subject of every check)
- [ ] Task: audit vs catalog management — selects
prompt_auditor.pyvsprompt_catalog_manager.pyand the whole workflow - [ ] Check focus — injection / bias / safety (sets which auditor checks run and the pass/fail bar)
Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.
Quick Start
# Audit a prompt for security and safety issues
python scripts/prompt_auditor.py --file system_prompt.txt
# Audit with specific focus
python scripts/prompt_auditor.py --text "You are a helpful assistant..." --checks injection,bias,safety
# Initialize a prompt catalog
python scripts/prompt_catalog_manager.py --init --catalog-dir ./prompts
# Add a prompt to the catalog
python scripts/prompt_catalog_manager.py --add --name "customer-support-v1" --file prompt.txt --catalog-dir ./prompts
# List all prompts in catalog
python scripts/prompt_catalog_manager.py --list --catalog-dir ./prompts
Tools Overview
| Tool | Purpose | Key Flags |
|------|---------|-----------|
| prompt_auditor.py | Audit prompts for injection, bias, and safety | --file, --text, --checks, --format |
| prompt_catalog_manager.py | Manage versioned prompt catalog | --init, --add, --list, --diff, --catalog-dir |
Workflows
Prompt Review Process
- Author writes or modifies a prompt
- Run
prompt_auditor.pyfor automated checks - Review findings and address critical issues
- Add approved prompt to catalog with
prompt_catalog_manager.py - Deploy from catalog (never from ad-hoc sources)
Prompt Versioning
- Store all prompts in catalog with semantic versioning
- Use
--diffto compare versions before promotion - Maintain audit trail of all prompt changes
- Roll back to previous versions when issues detected
Reference Documentation
- Prompt Governance Framework - Policies, review processes, and compliance requirements
Common Patterns
Prompt Lifecycle
Draft -> Audit -> Review -> Approve -> Deploy -> Monitor -> Retire
Governance Checklist
- No injection vulnerabilities
- No harmful content generation potential
- Appropriate bias mitigation
- Clear scope boundaries
- Output format constraints
- Error handling instructions