Agent-Skills.md

Agent Skills: Release Notes

>

UncategorizedID: arize-ai/phoenix/phoenix-release-notes

Repository

arize-ai/phoenix
Arize-aiLicense: NOASSERTION
9,073779

Install this agent skill to your local

pnpm dlx add-skill https://github.com/Arize-ai/phoenix/tree/HEAD/.agents/skills/phoenix-release-notes

Skill Files

Browse the full folder contents for phoenix-release-notes.

Download Skill

Loading file tree…

.agents/skills/phoenix-release-notes/SKILL.md

Skill Metadata

Name
phoenix-release-notes
Description
>

Release Notes

Create and publish release documentation for Phoenix. This skill walks through a structured workflow: identify undocumented releases, analyze commits by reading the actual code, draft MDX files, and update all the documentation touchpoints.

Tone and Style

Write for a developer who uses Phoenix daily. The voice is technical, friendly, and informative without being verbose.

  • Active voice, present tense: "Phoenix now provides..." not "A new feature has been added..."
  • Lead with what the user can do, not what changed internally. The reader cares about capabilities, not implementation details.
  • Concise: 1-3 sentence intro, then bullet points for details. If a bullet can say it, don't write a paragraph.
  • Code examples are mandatory when a feature has a programmatic API. Show working, copy-pasteable snippets. Show both Python and TypeScript when both SDKs are affected.
  • Version requirements in bold: **Available in arize-phoenix X.Y.Z+**
  • No PR numbers, commit hashes, or install commands in the release notes themselves.

Packages to Track

| Package | Tag pattern | |---------|------------| | arize-phoenix (server) | arize-phoenix-v* | | arize-phoenix-client (Python SDK) | arize-phoenix-client-v* | | arize-phoenix-evals | arize-phoenix-evals-v* | | arize-phoenix-otel | arize-phoenix-otel-v* | | @arizeai/phoenix-client (TS SDK) | Check js/packages/phoenix-client/package.json | | @arizeai/phoenix-cli (TS CLI) | Check js/packages/phoenix-cli/package.json | | @arizeai/phoenix-evals (TS evals) | Check js/packages/phoenix-evals/package.json | | @arizeai/phoenix-mcp (TS MCP) | Check js/packages/phoenix-mcp/package.json | | @arizeai/phoenix-otel (TS OTel) | Check js/packages/phoenix-otel/package.json |

Step 1: Identify Undocumented Releases

Compare GitHub releases against existing documentation to find the gap.

# Recent GitHub releases
gh release list --repo Arize-ai/phoenix --limit 30

# Existing release note files
ls docs/phoenix/release-notes/*/

# Dates already covered in the aggregate file
grep 'ReleaseUpdate label=' docs/phoenix/release-notes.mdx

Each <ReleaseUpdate> entry in the aggregate file covers a date. Multiple versions released on the same date get combined into one entry. Identify releases that have no corresponding coverage.

Step 2: Analyze Commits

For each undocumented release, examine the actual changes — not just the commit messages.

Get the changelog

gh release view <TAG> --repo Arize-ai/phoenix --json body --jq '.body'

The release body from release-please lists conventional commits with PR links. Use this as a starting index, then dig deeper.

Read the actual code

For each feat() and significant fix() commit, read the changed files to understand what the feature actually does. Commit messages are often terse — the code tells the real story. Key places:

  • Server REST endpoints: src/phoenix/server/api/routers/v1/
  • Python client SDK: packages/phoenix-client/src/phoenix/client/
  • TypeScript client SDK: js/packages/phoenix-client/src/
  • UI features: app/src/pages/
  • Evaluators: packages/phoenix-evals/src/phoenix/evals/
  • CLI: packages/phoenix-client/src/phoenix/client/cli/
  • Models/providers: playground and model configuration code

Classify each change

INCLUDE — things users interact with directly:

  • New API endpoints or SDK methods
  • New UI features or pages
  • New model or provider support
  • Breaking changes to public APIs
  • New CLI commands or flags
  • New evaluator types or capabilities
  • Performance improvements with visible user impact

EXCLUDE — internal housekeeping:

  • Dependency bumps (chore(deps):, fix(deps):)
  • Internal refactoring with no API surface change
  • Test additions or fixes
  • CI/CD and build changes
  • Code style or formatting changes
  • Internal tooling, repo-internal agent skills (.agents/skills/), or dev workflows with no product behavior change
  • Reverts that cancel out a feature within the same release

If a release contains only excluded changes, skip it — no release note needed.

Group related commits

Multiple commits often implement a single feature across server + client + UI. A REST endpoint commit, a Python client wrapper, and a TypeScript client wrapper should become one release note entry that mentions all relevant package versions — not three separate entries.

Step 3: Draft MDX Files

Default to a single consolidated file

Prefer one release note over many. Phoenix ships frequently, and a separate page per day produces a noisy, hard-to-scan release feed. Before creating files, look at the whole batch of undocumented releases together and ask: can these become one multi-topic file (Format B)?

Consolidate into a single file when the batch:

  • Spans a short window (roughly a week or a handful of consecutive patch/minor versions), or
  • Shares a theme (e.g. several time range, metrics, or PXI improvements), or
  • Individually would produce thin pages (one or two features each).

Each feature inside the consolidated file keeps its own # Heading, date line, and **Available in arize-phoenix X.Y.Z+** version line, so per-feature version provenance is preserved even though they share one page. The frontmatter title and file are dated by the latest release in the bundle, and the file description summarizes the whole bundle.

Only split into multiple files when a feature is genuinely large enough to deserve a standalone page (a major launch, a breaking change, or a feature with substantial code examples and its own media). When in doubt, consolidate — it is easier to read one well-organized page than five thin ones.

If you are revising an existing batch that was already split into several thin files, consolidate them: create one combined file dated by the latest release, delete the superseded files (git rm), and collapse their entries down to a single <ReleaseUpdate> block and a single year-overview <Card> and a single docs.json page path.

File location

docs/phoenix/release-notes/{MM-YYYY}/{MM-DD-YYYY}-{slug-title}.mdx

Create the month directory if it doesn't exist: mkdir -p docs/phoenix/release-notes/MM-YYYY

Frontmatter title rules (apply to BOTH formats)

Every release note MDX file — single-topic or multi-topic — must have a descriptive, date-prefixed title in its frontmatter. The title appears in browser tabs, the sidebar, and search results, so a generic "Release Notes" makes the page indistinguishable from the index page.

Required format: title: "MM.DD.YYYY: Descriptive Title"

  • ✅ title: "04.29.2026: Dataset Upsert"
  • ✅ title: "05.05.2026: REST API Updates"
  • ✅ title: "04.30.2026: Annotation Enhancements"
  • ❌ title: "Release Notes" — never use this; it collides with the index page
  • ❌ title: "Dataset Upsert" — missing the date prefix
  • ❌ title: "04.29.2026 Dataset Upsert" — missing the colon separator

For multi-topic files, the title summarizes the theme of the bundle (e.g. "04.30.2026: Annotation Enhancements"), not any single feature inside it.

Format A: Single-topic file

Use when one feature is significant enough to warrant its own page.

---
title: "MM.DD.YYYY: Feature Title"
description: "One-sentence description of the feature."
---

Introductory paragraph explaining what users can now do.

## Section Heading

- **Bold lead** describing a capability
- **Another point** with technical detail

```python
# Working Python example

// Working TypeScript example
<CardGroup cols={2}> <Card title="Related Doc" icon="book" href="/docs/phoenix/path"> Brief description </Card> </CardGroup> ```

Format B: Multi-topic file

Use when several features from a date range are combined into one file. The frontmatter title still follows the MM.DD.YYYY: Theme rule (see "Frontmatter title rules" above) — never use "Release Notes".

---
title: "MM.DD.YYYY: Theme Title"
---

# Feature Title One

Month DD, YYYY

**Available in arize-phoenix X.Y.Z+**

Description paragraph.

- **Bullet** describing capability

```python
# code example

Feature Title Two

Month DD, YYYY

Available in package-name X.Y.Z+

Description paragraph.


### Version line format

Match the version line to which packages are involved:

Available in arize-phoenix 13.14.0+ Available in arize-phoenix-client 2.0.0+ (Python) and @arizeai/phoenix-client 6.4.0+ (TypeScript) Available in arize-phoenix 13.13.0+ (server), arize-phoenix-client 1.31.0+ (Python) Available in arize-phoenix 15.1.0+ (beta) Breaking change in arize-phoenix-client 2.0.0


### Choosing between formats

| Situation | Format |
|-----------|--------|
| Multiple features across a short window or shared theme | **Format B — one consolidated file (default)** |
| A single, genuinely major feature or breaking change worth its own page | Format A |
| Feature spans server + client | One entry, mention all package versions |
| Breaking change | Prefix title with "Breaking Change:" |
| TS-only or Python-only feature | Show only the relevant language |
| Video/screenshot available | Use `<video>` or `<Frame>` in the relevant section of the file |

## Step 4: Update the Aggregate File

File: `docs/phoenix/release-notes.mdx`

Insert each new `<ReleaseUpdate>` block at the correct chronological position relative to **all**
existing blocks — not as a contiguous group at the top. Each block is a condensed summary
linking to the individual file.

The file imports the `ReleaseUpdate` component at the top (after the frontmatter):
```mdx
import { ReleaseUpdate } from "../snippets/ReleaseUpdate.jsx";

<ReleaseUpdate label="MM.DD.YYYY" href="/docs/phoenix/release-notes/MM-YYYY/MM-DD-YYYY-slug-title" title="Feature Title">
**Available in ...**

Brief 1-3 sentence summary. Action-oriented.

- **Key capability** with brief description
- **Another capability** with brief description
</ReleaseUpdate>

Rules:

  • label uses dot separators: MM.DD.YYYY
  • title is the feature title (without date prefix — the component generates label: title as the heading)
  • href is the link to the individual MDX file
  • Link path has no .mdx extension
  • Keep each block to 5-10 lines
  • For a consolidated multi-topic file, prefer a single <ReleaseUpdate> block labeled with the latest date, whose bullets summarize the bundled features — one block per file, not one per feature. Only split into multiple blocks when the bundled features fall on clearly distinct dates that each merit their own line in the feed.

Reverse-chronological insertion (do not skip this)

The aggregate file is sorted strictly newest-first by date. Existing entries are already ordered, so inserting a batch of new entries is a merge, not an append.

Wrong — stacking all new entries at the top as a contiguous block:

[NEW 05.05] [NEW 05.05] [NEW 04.30] [NEW 04.30] [NEW 04.29] [old 05.01] [old 04.28] ...
                                                              ^^^^^^^^^^
                                          older date appears AFTER newer dates — broken

Right — interleave each new entry with existing entries by date:

[NEW 05.05] [NEW 05.05] [old 05.01] [NEW 04.30] [NEW 04.30] [NEW 04.29] [old 04.28] ...

Procedure when adding multiple entries:

  1. List every date you are adding.
  2. Read the existing labels in order: grep -n 'Update label=' docs/phoenix/release-notes.mdx
  3. For each new entry, find the first existing label whose date is strictly older, and insert the new block immediately before it. Same-date ties stay together.
  4. After inserting, re-run the grep and read the dates top-to-bottom — they must be monotonically non-increasing. If any older date appears above a newer one, fix it before moving on.

Step 5: Update the Year Overview

File: docs/phoenix/release-notes/YYYY.mdx (e.g., 2026.mdx)

Add a <Card> entry at the top of the <CardGroup>:

<Card href="/docs/phoenix/release-notes/MM-YYYY/MM-DD-YYYY-slug-title" arrow="true" title="MM.DD.YYYY" icon="calendar" description="Brief description of the feature"/>

Step 6: Update Navigation

File: docs.json (repository root)

Find the "Release Notes" tab. Add new page paths to the appropriate monthly group.

If the month group exists

Add the page path to the existing group's pages array (newest first):

{
  "group": "MM.YYYY",
  "pages": [
    "docs/phoenix/release-notes/MM-YYYY/MM-DD-YYYY-new-page",
    "docs/phoenix/release-notes/MM-YYYY/existing-page"
  ]
}

If the month group doesn't exist

Create a new group object in the correct chronological position (newest month first, after the aggregate page entry):

{
  "group": "MM.YYYY",
  "pages": [
    "docs/phoenix/release-notes/MM-YYYY/MM-DD-YYYY-slug-title"
  ]
}

Page paths: forward slashes, no leading slash, no .mdx extension.

Step 7: Update GitHub Release Description (Optional)

Only when explicitly requested. The default release-please changelog is acceptable.

You MUST preserve the existing release body. First fetch it, then prepend a highlights section:

# 1. Fetch the existing release body
EXISTING_BODY=$(gh release view <TAG> --repo Arize-ai/phoenix --json body --jq '.body')

# 2. Prepend highlights and wrap the original body in a details block
gh release edit <TAG> --repo Arize-ai/phoenix --notes "$(cat <<EOF
## Highlights

### Feature Title
Description with user-facing framing.

See the [release notes](https://docs.arize.com/phoenix/release-notes/MM-YYYY/MM-DD-YYYY-slug) for details.

---
<details>
<summary>Conventional commits</summary>

$EXISTING_BODY
</details>
EOF
)"

Step 8: Verify

Before considering the work complete, check every touchpoint:

  1. Files exist: All new MDX files are at expected paths
  2. Frontmatter valid: Each file has YAML frontmatter with at least title
  3. Aggregate links resolve: Every /docs/phoenix/release-notes/... path in the aggregate file matches an actual file
  4. Year overview updated: New cards point to correct paths
  5. Navigation complete: docs.json contains all new page paths with no dangling references
  6. Reverse-chronological order: Entries in aggregate file, year overview, and docs.json are newest-first
  7. Code examples valid: Snippets are syntactically correct with no placeholder values
  8. No internal changes leaked: Double-check that no dependency bumps, refactors, or test-only changes made it into user-facing notes

Quick validation

# Verify aggregate links point to real files
grep -oP '(?<=\()/docs/phoenix/release-notes/[^)]+' docs/phoenix/release-notes.mdx | while read path; do
  file="${path}.mdx"
  [ -f "$file" ] || echo "MISSING: $file"
done

# Catch any new file that still has the generic "Release Notes" title
grep -l '^title: "Release Notes"$' docs/phoenix/release-notes/**/*.mdx 2>/dev/null \
  && echo "FAIL: file(s) above use the generic 'Release Notes' title — must be 'MM.DD.YYYY: ...'" \
  || echo "OK: all per-date files have descriptive titles"

# Confirm reverse-chronological order in the aggregate file
grep -nP 'ReleaseUpdate label="[\d.]+' docs/phoenix/release-notes.mdx \
  | awk -F'[:."]' '{ printf "%s %s%s%s\n", $1, $5, $3, $4 }' \
  | awk 'NR>1 && $2>prev { print "OUT OF ORDER at release-notes.mdx:" $1 " — " $2 " appears above " prev; bad=1 } { prev=$2 } END { if (!bad) print "OK: reverse-chronological order intact" }'

Decision Quick Reference

| Question | Answer | |----------|--------| | Release has only dep bumps? | Skip — no release note | | Feature reverted in same release? | Exclude both feat and revert | | Month directory missing? | Create it with mkdir -p | | Month nav group missing in docs.json? | Add new group object | | Feature spans multiple packages? | One entry, list all versions | | Not sure if user-facing? | Read the code — if a user can't see or call it, exclude it |

Pre-Submit Checklist

Before opening a PR or considering the work done, walk through every item below. Do not skip any.

Steps completed

  • [ ] Step 1: Identified all undocumented releases
  • [ ] Step 2: Analyzed commits by reading the actual changed code, not just commit messages
  • [ ] Step 3: Drafted individual MDX files with correct frontmatter and file paths
  • [ ] Step 4: Updated the aggregate file (release-notes.mdx) with <Update> blocks
  • [ ] Step 5: Updated the year overview (YYYY.mdx) with <Card> entries
  • [ ] Step 6: Updated docs.json navigation with all new page paths
  • [ ] Step 7: (Only if requested) Updated GitHub release descriptions, preserving existing body
  • [ ] Step 8: Ran verification — all links resolve, order is correct, no dangling references

Technical writing review

Review every MDX file you created as an expert technical writer:

  • [ ] Lead with user value: Every section opens with what the user can now do, not what changed internally
  • [ ] Active voice, present tense: No passive constructions like "has been added" or "was implemented"
  • [ ] Concise: No filler, no preamble. If a bullet can say it, don't write a paragraph
  • [ ] Consistent terminology: Use the same term for the same concept throughout — don't alternate between synonyms
  • [ ] Scannable structure: Headings, bold leads on bullets, code blocks. A reader skimming should get the gist
  • [ ] No jargon leaks: No internal class names, module paths, or implementation details unless they are part of the public API
  • [ ] Version lines are accurate: Each entry states the correct package names and minimum versions

Code snippet validation

Every code example must be grounded in real code — no hallucinated APIs:

  • [ ] Verified against source: For each snippet, you read the actual implementation to confirm the function signatures, parameter names, return types, and class names are correct
  • [ ] Import paths are real: Any import or from statements use actual module paths from the codebase
  • [ ] Runnable as-is: Snippets are syntactically valid and copy-pasteable — no placeholder values like YOUR_KEY or ... unless explicitly documenting a user-provided value
  • [ ] Both languages when applicable: If a feature has both Python and TypeScript SDKs, both examples are included and verified

Formatting and linting

  • [ ] Valid MDX: Each file has YAML frontmatter with at least title, all JSX components are properly closed
  • [ ] Frontmatter title is date-prefixed: title: "MM.DD.YYYY: Descriptive Title" — never "Release Notes" (which is reserved for the index page) and never missing the date prefix
  • [ ] Aggregate order is reverse-chronological: After inserting new entries, read the labels top-to-bottom in release-notes.mdx. Dates must be monotonically non-increasing — no older date ever appears above a newer one. New entries must be interleaved with existing ones by date, not stacked as a contiguous block at the top.
  • [ ] No trailing whitespace or extra blank lines
  • [ ] Fenced code blocks have language tags: Every ``` block specifies python, typescript, bash, json, etc.
  • [ ] Links have no .mdx extension: All internal doc links use extensionless paths
  • [ ] Consistent date formats: MM.DD.YYYY in labels and headings, MM-DD-YYYY in file paths