Skip to content
EventOnlinePast event

The LLM Gateway: Build and Operate One in One Hour

Event artwork for The LLM Gateway: Build and Operate One in One Hour

This event has ended

This listing is kept as an archive. Explore upcoming events to find your next one.

See upcoming events
About this event

What to expect

Build, break and productionise an LLM gateway in this one-hour online workshop for DevOps, platform, cloud, SRE and security practitioners.

Running one application against one model provider is manageable. Once several applications and providers are involved, teams can quickly accumulate duplicated authentication, retries, timeout handling, failover behaviour and incompatible logs. This hands-on session from The DevOps World Meetup Group demonstrates how an LLM gateway can replace that sprawl with a controlled, observable access point.

Taking place online on Friday 28 August 2026, from 18:30 to 19:30, the session follows a practical build-first format. Host Bishwas J. will build one gateway live, deliberately break it, add controls and then examine what is required to operate it as a shared production service.

What the session covers

  • Security: removing provider credentials from individual applications and centralising access controls.
  • Reliability: understanding the distinct roles of retries, cooldowns and fallback,and how confusing them can turn a provider issue into a wider outage.
  • Observability: tracking request and failure rates, provider latency, time to first token, rate-limit responses, retry counts and fallback counts.
  • DevOps: keeping secrets out of gateway configuration so it becomes a deployable Git artifact with pull requests, testing and a rollback path.

Follow along or watch

To complete the exercises alongside the presenter, have Docker and Docker Compose v2 running, plus curl, jq and one provider API key. A second provider key is optional, although it makes the failover demonstration clearer. If your environment is not ready, you can still attend as an observer rather than spending the hour troubleshooting setup.

Attendees receive the complete repository used during the demonstration, including the Docker Compose stack, gateway configuration, demo scripts, CI policy validator, Prometheus alert rules and on-call runbooks. This makes the event particularly useful for people who want both an architectural explanation and practical assets they can inspect afterwards.…

Register for this event

Running an AI event?

List it here, free.

Meetups, workshops and conferences go in front of thousands of builders after a quick review.

List your event