Diffusion TV: Experiencing Diffusion Models through Tangible Interaction
Diffusion TV is an interactive art installation that uses a modified CRT TV to allow users to physically experience diffusion models. By manipulating the TV's antenna and tuning knob, audiences control AI-generated images and sounds, exploring the denoising process and intermediate states of generative AI.
Reading in Plain English mode — toggle below to switch
Diffusion TV is an interactive art installation that uses a modified CRT TV to allow users to physically experience diffusion models. By manipulating the TV's antenna and tuning knob, audiences control AI-generated images and sounds, exploring the denoising process and intermediate states of generative AI.
Imagine a radio where turning the dial doesn't just change stations, but physically clarifies a blurry image or sound generated by AI. Diffusion TV lets you 'tune in' to the generative process, making the abstract concept of denoising tangible, much like adjusting an old antenna to get a clearer picture.
How Diffusion TV Works
- 1A modified CRT TV serves as the interface for the AI art installation.
- 2Users physically manipulate the TV's antenna to control the clarity of AI-generated images and sounds.
- 3This physical manipulation metaphorically represents the denoising process inherent in diffusion models.
- 4A tuning knob allows participants to switch between three 'channels' featuring AI-generated animals from different temporal contexts: Past (extinct), Present (endangered), and Future (speculative).
- 5Continuous audiovisual feedback is provided, foregrounding the generative process and allowing exploration of intermediate states rather than just final outputs.
An audience member turns the antenna on the Diffusion TV, and a blurry, noisy image of a speculative future creature gradually resolves into a clearer form, accompanied by evolving sounds. They then turn the tuning knob to switch to a channel displaying an endangered species, experiencing the AI's generation process for a different theme.
Diffusion TV offers an embodied, interactive mode of explainable AI, allowing users to explore the generative process of diffusion models through physical manipulation rather than explicit technical explanations.