Spline User Adds Real-Time Clay Colorization to Hand-Tracking Pottery App.

A developer has released new features for a hand-tracking pottery application that lets users sculpt virtual clay using their webcam or mouse. The update adds real-time colorization and customizable clay base shapes to the interactive experience.

Joseph Azar announced the improvements on LinkedIn, highlighting two core additions: the ability to colorize clay as users shape it and options to modify the base geometry of the clay form. The application detects hand movements through a webcam using MediaPipe's hand-tracking library, but gracefully falls back to mouse input for users without camera access.

The pottery app combines three major technologies. Spline's Omma AI platform handles the 3D scene generation and interaction logic, while Three.js provides the WebGL rendering foundation. MediaPipe supplies the computer vision layer for real-time hand tracking.

Omma AI, which Spline launched in March 2026, uses a multi-agent workflow to generate code, 3D meshes, and interactive scenes from natural language descriptions. The platform can orchestrate multiple tasks simultaneously, including physics simulations and real-time visual effects. This project demonstrates how developers are using Omma to build sophisticated web experiences that blend computer vision with 3D graphics.

The hand-tracking functionality relies on MediaPipe's pre-trained models to identify hand landmarks in video frames. These coordinates drive the virtual pottery wheel, translating physical gestures into digital sculpting actions. When a webcam isn't available, the same interaction model maps to cursor position and mouse buttons.

This pottery app joins a wave of experimental projects built with Omma AI. Developers have recently created webcam-controlled dice games and custom GLSL shader experiments using the platform. The tool's support for Three.js, React Three Fiber, and WebGPU has made it particularly popular for prototyping interactive web applications that would traditionally require extensive manual coding.

The real-time colorization feature addresses a common limitation in browser-based 3D experiences: dynamic material updates without performance penalties. By handling color changes at the shader level, the app maintains smooth frame rates even as users modify both geometry and appearance simultaneously.

Key capabilities in the updated app:

• Live hand tracking via webcam with MediaPipe
• Mouse fallback for users without camera hardware
• Real-time clay colorization during sculpting
• Adjustable base shapes for the clay form
• Browser-based deployment with no installation required

Azar shared a demo link in the LinkedIn post comments, allowing other developers to test the experience directly in their browsers. The project illustrates how AI-assisted development platforms are lowering the barrier to building complex interactive applications, particularly for creators who may not have deep expertise in computer graphics or computer vision.

For developers interested in similar projects, Omma AI supports importing GLB and GLTF 3D models, connecting to real-world data through CSV and JSON files, and deploying instantly with custom domain support. The platform remains in beta as Spline continues refining the multi-agent generation system.