Agency Docs Updater
Execute ALL steps automatically in sequence. Only pause if a step fails and cannot be recovered. Read references/learnings.md before starting for known pitfalls.
Configuration: paths are read from .env in the skill root (see .env.example). Defaults work for the standard setup. Key env vars: VAULT_DIR, DOCS_SITE_DIR, YOUTUBE_UPLOADER_DIR, PRESENTATIONS_DIR, SKILLS_REPO_DIR, SKILLS_LOCAL_DIR, ZOOM_CREDENTIALS_DIR, GITHUB_REPO, SITE_DOMAIN.
Dependencies (verify these exist before running):
- zoom — Zoom recording download (
scripts/zoom_meetings.py) - fathom — Fathom video fallback (
scripts/download_video.py) - nano-banana — thumbnail overlay generation (
scripts/generate_image.sh) - calendar-sync — local-only, calendar event sync (
sync.sh) - youtube-uploader — video processing, upload, and YouTube API auth
Step 0: Parse Arguments & Load Config
Load .env from skill root. Then split args by whitespace:
- 8-digit token (
YYYYMMDD) →DATE - "yesterday" →
DATE = $(date -v-1d +%Y%m%d) - "today" or missing →
DATE = $(date +%Y%m%d) - 2-digit token (
NN) orlab-NN→LAB_FILTER
Expand env vars for paths used in subsequent steps:
VAULT_DIR="${VAULT_DIR:-$HOME/Brains/brain}"
DOCS_SITE_DIR="${DOCS_SITE_DIR:-$HOME/Sites/agency-docs}"
YOUTUBE_UPLOADER_DIR="${YOUTUBE_UPLOADER_DIR:-$HOME/ai_projects/youtube-uploader}"
SKILLS_REPO_DIR="${SKILLS_REPO_DIR:-$HOME/ai_projects/claude-skills}"
SKILLS_LOCAL_DIR="${SKILLS_LOCAL_DIR:-$HOME/.claude/skills}"
ZOOM_CREDENTIALS_DIR="${ZOOM_CREDENTIALS_DIR:-$HOME/.zoom_credentials}"
PRESENTATIONS_DIR="${PRESENTATIONS_DIR:-$HOME/ai_projects/claude-code-lab}"
GITHUB_REPO="${GITHUB_REPO:-glebis/agency-docs}"
SITE_DOMAIN="${SITE_DOMAIN:-agency-lab.glebkalinin.com}"
Step 1: Find Fathom Transcript
If LAB_FILTER is set: ${VAULT_DIR}/${DATE}-claude-code-lab-${LAB_FILTER}.md
If empty: glob ${VAULT_DIR}/${DATE}-claude-code-lab-*.md (pick most recent by mtime).
If missing: run ${SKILLS_LOCAL_DIR}/calendar-sync/sync.sh, re-check, stop if still missing.
Extract from YAML frontmatter and store:
FATHOM_FILE,SHARE_URL,MEETING_TITLE,DATE,LAB_NUMBERVIDEO_NAME=${DATE}-claude-code-lab-${LAB_NUMBER}TRANSCRIPT_LANG= auto-detect from first ~50 lines (Cyrillic ratio > 0.3 →ru, elseen)
Determine MEETING_NUMBER: check existing MDX files in ${DOCS_SITE_DIR}/content/docs/claude-code-internal-${LAB_NUMBER}/meetings/ for a placeholder with today's date. If found, use that number. Otherwise, check file content sizes to find the next empty slot. Store as zero-padded two-digit string (e.g. 04). This variable is used in Steps 3b, 4b, 5, 6, and 8.
Step 2: Download Video
Skip if ${VAULT_DIR}/${VIDEO_NAME}.mp4 exists and is > 1MB.
Note: Zoom recordings may take ~15 minutes to process after a meeting ends. If the Zoom API returns no recordings, wait and retry before falling back to Fathom.
Primary — Zoom:
python3 ${SKILLS_REPO_DIR}/zoom/scripts/zoom_meetings.py recordings \
--start ${DATE:0:4}-${DATE:4:2}-${DATE:6:2} \
--end $(date -j -v+1d -f %Y%m%d ${DATE} +%Y-%m-%d) \
--show-downloads 2>&1
Find the MP4 URL, then:
TOK=$(python3 -c "import json,pathlib; print(json.load(open(pathlib.Path('${ZOOM_CREDENTIALS_DIR}')/'oauth_token.json'))['access_token'])")
curl -L -H "Authorization: Bearer ${TOK}" -o ${VAULT_DIR}/${VIDEO_NAME}.mp4 "${MP4_DOWNLOAD_URL}"
Fallback — Fathom (if no Zoom recording):
cd ${VAULT_DIR} && python3 ${SKILLS_LOCAL_DIR}/fathom/scripts/download_video.py \
"${SHARE_URL}" --output-name "${VIDEO_NAME}"
Step 3: Upload to YouTube
cd ${YOUTUBE_UPLOADER_DIR} && \
python3 process_video.py \
--video ${VAULT_DIR}/${VIDEO_NAME}.mp4 \
--fathom-transcript ${FATHOM_FILE} \
--title "${MEETING_TITLE}" \
--upload
Run with run_in_background: true (10-30 min). On failure: --resume-from upload.
Extract YOUTUBE_URL from stdout (✓ YouTube video: ...) or processed/metadata/${VIDEO_NAME}.json.
Extract VIDEO_ID from the URL (the part after ?v= or last path segment).
Start Step 4 in parallel — summary doesn't depend on YouTube URL.
Step 3b: Lab-Style Thumbnail (REQUIRED)
Always run this step — it replaces the generic thumbnail from process_video.py with the branded lab template. The generic thumbnail is NOT acceptable for publishing.
Prerequisites: VIDEO_ID must be known (wait for Step 3 to complete if needed).
Follow references/thumbnail-guide.md for the full workflow:
- Generate Nano Banana overlay image (topic-specific prompt from the guide's prompt patterns)
- Read/inspect raw image to confirm background color, then recolor lines to orange (#e85d04)
- Write a temporary HTML file (e.g.
/tmp/lab-meeting-${MEETING_NUMBER}.html) based on${YOUTUBE_UPLOADER_DIR}/templates/images/lab-meeting.html— update meeting number, topic hero text, bullet descriptions, date. Do not edit the original template in-place. - Render with Playwright at 1280×720 →
${YOUTUBE_UPLOADER_DIR}/processed/thumbnails/${VIDEO_NAME}.jpg - Read/inspect the rendered thumbnail to verify layout before uploading
- Upload to YouTube: use
VIDEO_IDextracted from Step 3
Do NOT skip this step or rely on the process_video.py thumbnail.
Step 4: Generate Fact-Checked Summary
Read ${FATHOM_FILE}. Generate a structured summary in ${TRANSCRIPT_LANG}:
##section headers, bullet points, code examples where relevant- Technical terms in English (MCP, Skills, Claude Code, etc.)
- Exclude personal scheduling details
- Sanitize for MDX: escape
<,>, and bare{characters that would break MDX compilation
Fact-check Claude Code feature claims using claude-code-guide subagent (if available; skip fact-checking if the agent is not accessible). Save corrected summary to scratchpad as summary.md.
Step 4b: Update YouTube Metadata
After both Step 3 and Step 4 complete. VIDEO_ID, MEETING_NUMBER, and LAB_NUMBER must all be determined before this step. Read references/youtube-api.md for description format and API snippets.
Generate YouTube description from the summary. Use the language-appropriate template:
- If
TRANSCRIPT_LANG=en: English labels ("In this video:", "Course materials and session notes:") - If
TRANSCRIPT_LANG=ru: Russian labels ("В этом видео:", "Материалы и конспект занятия:")
Do NOT mix languages in a single description.
Meeting page URL: https://${SITE_DOMAIN}/docs/claude-code-internal-${LAB_NUMBER}/meetings/${MEETING_NUMBER}
Update title, description, tags via YouTube API, then add video to playlist "Claude Code Lab ${LAB_NUMBER}" (auto-created if it does not exist).
Step 5: Generate MDX
python3 ${SKILLS_LOCAL_DIR}/agency-docs-updater/scripts/update_meeting_doc.py \
${FATHOM_FILE} "${YOUTUBE_URL}" ${SCRATCHPAD}/summary.md
Before running: check if a placeholder MDX already exists for today's date (grep -l in meetings/). If so, use -n ${MEETING_NUMBER} --update to target it.
After running:
- Strip appended Marp content (everything after summary's closing
---before<!-- _class: lead -->) — MDX breaks on HTML comments (<!-- -->), unescaped<, and bare{characters - Check for presentation file: look in
${PRESENTATIONS_DIR}/presentations/lab-${LAB_NUMBER}/and${PRESENTATIONS_DIR}/lesson-generator/for files matching${DATE}. If found, copy to${DOCS_SITE_DIR}/public/${DATE}-claude-code-lab-${LAB_NUMBER}.htmland add link in MDX - Replace frontmatter placeholders (
[Название встречи],[Краткое описание встречи],[Дата встречи]) - If
TRANSCRIPT_LANG=en, rewrite the MDX entirely with English labels — the script defaults to Russian and the translation fallback produces broken mixed-language output - Verify:
cd ${DOCS_SITE_DIR} && npm run build 2>&1 | tail -5
Step 6: Commit and Push
Only stage pipeline files — never git add .:
cd ${DOCS_SITE_DIR}
git fetch origin main
BEHIND=$(git rev-list --count HEAD..origin/main)
if [ "$BEHIND" -gt 0 ]; then
git stash push -m "agency-docs-updater: temp stash"
git pull --rebase origin main
git stash pop || true
fi
git add content/docs/claude-code-internal-${LAB_NUMBER}/meetings/${MEETING_NUMBER}.mdx
# Only stage presentation HTML if it was copied
[ -f public/${DATE}-claude-code-lab-${LAB_NUMBER}.html ] && git add public/${DATE}-claude-code-lab-${LAB_NUMBER}.html
git commit -m "Add Lab ${LAB_NUMBER} Meeting ${MEETING_NUMBER}"
git push
Store COMMIT_HASH=$(git rev-parse HEAD) for Step 7.
Step 7: Wait for Vercel Deploy
TIMEOUT=300; ELAPSED=0
until [ "$(gh api repos/${GITHUB_REPO}/commits/${COMMIT_HASH}/status --jq '.state' 2>/dev/null || echo 'pending')" != "pending" ]; do
sleep 15; ELAPSED=$((ELAPSED+15))
[ "$ELAPSED" -ge "$TIMEOUT" ] && echo "Deploy timeout after ${TIMEOUT}s" && break
done
DEPLOY_STATE=$(gh api repos/${GITHUB_REPO}/commits/${COMMIT_HASH}/status --jq '.state')
echo "Deploy state: ${DEPLOY_STATE}"
Run with run_in_background: true. If state is failure or error: check Vercel logs (vercel logs), fix locally, re-push, restart this step.
Step 8: Verify in Browser
Open https://${SITE_DOMAIN}/docs/claude-code-internal-${LAB_NUMBER}/meetings/${MEETING_NUMBER} in a browser (via chrome automation tools or manually). Verify YouTube embed is visible. If not: check VIDEO_ID, wait for YouTube processing, or re-upload.
Pipeline Report
After completion, report: Fathom path, video path, YouTube URL, MDX path, commit hash, deploy status, embed verification.