Skip to content
All tool news

Tool desk · Updated daily

Tool news·PostHog·

PostHog Adds LLM Clusters, Prompt Management, and Playground.

PostHog launched Clusters for organizing LLM activity, plus beta prompt management and a prompt playground for testing prompts.

CW

Create With tool desk

1 source checked · 1 min read

ShareLinkedIn
PostHog Adds LLM Clusters, Prompt Management, and Playground

PostHog has announced several new AI observability and prompt tooling updates. The release introduces Clusters, a feature designed to organize recent LLM activity into grouped patterns, alongside prompt management in beta and a new prompt playground for testing and comparing prompt setups.

Key updates include:

  • Clusters: Runs daily and groups the last 7 days of AI activity into similar buckets.
  • Bucket insights: Each cluster includes a name, summary, and metrics such as cost, latency, error rate, and token usage.
  • 2D scatter plot: An interactive visualization helps teams explore similar events, identify outliers, and inspect unusual activity.
  • Prompt management (beta): Users can store system prompts in PostHog, fetch them at runtime, and update prompts without deploying code changes.
  • Prompt playground: A sandbox for testing prompt variations and comparing models and providers side by side.

For small business owners and builders, these updates could make it easier to monitor LLM usage, control prompt changes, and diagnose issues without building separate internal tooling. The additions may be especially useful for teams experimenting with AI features while trying to manage cost, reliability, and iteration speed.

Sources

1 checked

How we cover tool news: Create With's tool desk drafts these reports with AI from the sources listed above and checks them against those sources before publishing.

Worth passing on?

ShareLinkedIn

Latest tool news

What else changed this week.

All tool news
VercelDigest

What Vercel Shipped in Late October

Vercel shipped quicker static deployments, four AI Gateway models, more free domain choices and new CLI controls in late October. The changes cover developers testing sites…

Vercel

Vercel Adds Submit_feedback to Its MCP

submitfeedback is a new Vercel MCP tool that lets agents and harnesses send bug reports, friction reports and feature requests directly to the Vercel team. Feedback can include…

The Create With Briefing

Don't watch forty changelogs. Read one email.

Every Tuesday: the tool changes worth knowing, real business use cases, and what's on near you. Free, unsubscribe any time.