IPAB Workshop - 05/11/2026

Title: Beyond Generation: Interactive and Controllable 3D Content Creation

Abstract:  Generative AI has made it increasingly easy to create complex visual and 3D content, but enabling users to precisely control and interact with the generation process remains an open challenge. In this talk, I will discuss our recent efforts towards interactive and controllable 3D generation, where intuitive user inputs are used to guide the creation of dynamic and articulated content.

I will present two recent projects: DancingBox, a CHI Best Paper Honorable Mention, which explores the use of simple physical proxies for intuitive control of 3D animation; and Sketch2Arti, which enables users to create articulated 3D objects from sketches. Together, these works explore how generative models can move beyond one-shot content creation towards more interactive, interpretable, and user-controllable creative tools.