Generative Tutorial: Towards Live Contextualized Visual Instructions for Physical Tasks
Visual instructions for physical tasks are typically authored in one context and followed in another, requiring users to translate demonstrated tools, materials, and spatial relationships into their own environment. We introduce Generative Tutorial, a conceptual framework for live visual instruction that depicts intended outcomes and actions within the user's environment and ta
Reading in Plain English mode — toggle below to switch
Visual instructions for physical tasks are typically authored in one context and followed in another, requiring users to translate demonstrated tools, materials, and spatial relationships into their own environment. We introduce Generative Tutorial, a conceptual framework for live visual instruction that depicts intended outcomes and actions within the user's environment and ta
This paper introduces a novel approach to providing live, contextualized visual instructions for physical tasks, moving beyond static guides. For ML engineers, this highlights the growing importance of real-time multimodal AI systems that integrate vision, language, and environmental context to assist users in practical applications.