Skip to content
MeetupIn personPast event

From Big Model to Small Model: Distill Your Own Agent LLM

Event artwork for From Big Model to Small Model: Distill Your Own Agent LLM

This event has ended

This listing is kept as an archive. Explore upcoming events to find your next one.

See upcoming events in Montreal
About this event

What to expect

Master the art of LLM distillation in this hands-on technical workshop where you'll learn to transform large language models into efficient, specialized agent-focused systems. Hosted by Montreal AWS Users United, this two-day intensive brings together developers, ML engineers, and AI practitioners to explore cutting-edge techniques for creating compact, task-specific language models without sacrificing performance.

What You'll Learn

This workshop tackles one of the most pressing challenges in AI development: how to deploy powerful language models in resource-constrained environments. You'll gain practical experience with model distillation techniques that allow you to compress large foundational models (like GPT-4, Claude, or Llama) into smaller, faster versions optimized for specific agent tasks. The curriculum covers knowledge distillation fundamentals, dataset preparation, fine-tuning strategies, and performance optimization.

Whether you're building customer service bots, automation agents, or specialized AI assistants, you'll leave with actionable skills for creating models that run efficiently on edge devices, reduce inference costs, and maintain low latency while preserving the reasoning capabilities of their larger counterparts.

Who Should Attend

This event is ideal for software engineers working with AI systems, machine learning practitioners looking to optimize deployment costs, and technical founders building agent-based products. Intermediate Python experience and familiarity with transformer architectures is recommended. If you're frustrated by the computational overhead of large models or seeking to deploy AI agents in production environments with strict performance requirements, this workshop provides the technical foundation you need.

Event Format

Expect a blend of technical presentations, live coding demonstrations, and hands-on exercises using AWS infrastructure and popular ML frameworks. The Montreal AWS Users United community brings together cloud-native developers with a focus on scalable, production-ready solutions. You'll work alongside peers facing similar challenges and have opportunities to troubleshoot real distillation scenarios during the two-day program.

Register for this event

Running an AI event in Montreal?

List it here, free.

Meetups, workshops and conferences go in front of thousands of builders after a quick review.

List your event