Skip to content
MeetupOnlinePast event

Crafting Evals : Signals v/s noise

Explore the topics

Event artwork for Crafting Evals : Signals v/s noise

This event has ended

This listing is kept as an archive. Explore upcoming events to find your next one.

See upcoming events
About this event

What to expect

Crafting Evals : Signals v/s noise

Online meetup by Innovate QA Seattle Meetup Group exploring how to rigorously evaluate LLM-driven systems. Learn structured frameworks — including LLM-as-a-judge, golden datasets, and multi-dimensional quality metrics — to distinguish true product improvements from noise in AI and ranking experiments.

Speaker: Alekhya Guduri (LinkedIn)

When & where: Tuesday, May 12, 2026, 4:00 PM (Online)

Agenda:

  • 4:00–4:05 Welcome
  • 4:05–4:55 Talk: Crafting Evals : Signals v/s noise
  • 4:55–5:00 Closing

What you’ll explore: practical methods for evaluating LLM-driven systems using structured frameworks, multi-step QA processes, and clear criteria to separate meaningful product signals from noise.

Speaker opportunities: The meetup invites QA, leadership, or tech experts to share topics; submit your topic via the form linked on the page: https://docs.google.com/forms/d/e/1FAIpQLSc4Ui67V4ER9s1dSSMJfKi3M-m-RSUuJD6ibDNq12oyv1Yt5w/viewform

Related topics: AI and Society; Agile Testing; Software Engineering; Software QA and Testing; Test Automation.

Registration: Register for the event

Running an AI event?

List it here, free.

Meetups, workshops and conferences go in front of thousands of builders after a quick review.

List your event