“Vibe Painting” (2026)
Interaction Design / Creative Technology
Key Visual
GAME / INTERACTION FUNCTIONS
1. Breath Interaction
Participants can blow toward the camera or microphone to generate expanding clouds of color and fluid particle diffusion.
Different breathing intensities affect the scale, speed, and emotional density of the visual output.
Visual Effects
- Dynamic color blooming
- Ink/water diffusion simulation
- Floating particles
- Atmospheric motion fields
2. Finger Gesture Interaction
Hand and finger tracking allow users to directly manipulate visual materials in space.
Functions
- Push and drag particles
- Blend colors like liquid paint
- Generate ripple distortions
- Create motion trails and fluid deformation
3. Blink Recognition
Eye blinking triggers hidden symbolic elements within the system.
Depending on the selected mode:
- blinking generates stars,
- floating numerical symbols,
- or hidden visual fragments.
This mechanism transforms unconscious bodily behavior into poetic digital output, emphasizing the relationship between attention, awareness, and machine perception.4. Mood-Based Color System
The project includes a customizable emotional palette system inspired by:
- Morandi colors,
- pastel gradients,
- natural elements,
- and AI-generated atmospheric color mapping.
Participants can influence the emotional tone of the environment through simple prompts or interaction patterns.
5. Finish & Save System
At the end of each session, the system freezes the generative canvas and transforms it into a final “Vibe Painting” poster.
The output acts as:
- a memory trace,
- emotional snapshot,
- or digital self-portrait generated through interaction.
Landing Experience & System Interface Design
Gesture Recognition–Based Interactive Interface Design
Customized Poster Generation Output
Design Elements
Interactive Interface Design
TECHNOLOGY USED
COMPUTER VISION
- MediaPipe Hand Tracking
- Face Landmark Detection
- Blink Detection Algorithms
- Real-Time Motion Tracking
GENERATIVE VISUAL SYSTEM
- Particle Systems
- Fluid Simulation
- Procedural Animation
- Noise & Motion Field Generation
CREATIVE CODING & RENDERING
- JavaScript
- HTML/CSS
- Canvas API
- Three.js / WebGL
- React & React Three Fiber (R3F)
AI/ INTERACTIVE SYSTEMS
- AI-assisted visual generation workflows(Gemini 3)
- Real-time interaction mapping
- Emotional parameter systems
- Generative behavior design
Exhibition Picture “Pleasure Engineered”
Installation View at Accent Sisters “Pleasure Engineered”
“Pleasured Engineered” Exhibition Poster
ROLE
Creative Technologist
Interaction Designer
INTRODUCTION
Vibe Painting is an AI-driven interactive visual system that transforms human gestures, breath, blinking, and subtle bodily movements into real-time generative imagery.
Positioned between game, installation, and emotional interface, the project explores how invisible human emotions can be translated into fluid digital landscapes through computer vision and generative systems. Rather than functioning as a traditional game with fixed goals, Vibe Painting creates an open-ended sensory experience where participants “paint” using their body, mood, and presence.
Through blowing, finger movement, eye blinking, and spatial interaction, colors, particles, stars, numbers, and abstract visual elements continuously emerge, dissolve, and reorganize on screen — forming a living emotional canvas that is never repeated twice.
Inspired by meditation practices, emotional computing, East Asian aesthetics, and generative art, the system treats interaction not as command, but as a process of resonance between human perception and machine interpretation.