Gestural Interactions is an ongoing graduation project that explores how embodied gestures can create immersive, playful digital experiences. By using the body as a primary input, it examines how gesture-driven systems enable intuitive interaction, co-creation, and emotional engagement. A key application is sign language learning, where gesture-based games for deaf children and their families show how embodiment can support communication, accessibility, and learning.
Gesture Plotter
The Gesture Plotter is a gesture-controlled vertical plotter that explores the relationship between human movement and machine expression. As the participant moves their hand in space, the machine translates these gestures into drawn lines, creating a tangible record of embodied interaction. The work investigates how physical presence and motion can serve as a form of authorship, blurring the boundary between human and robotic agency. By framing the machine as both interpreter and collaborator, it reflects on the poetic potential of human-robot interaction.
ASL Game
Sign to Strike is a gesture-based web game that explores the potential of gesture-based interaction in sign language learning. It uses real-time ASL fingerspelling recognition to engage players in a fast-paced interactive challenge. Letters fall from the top of the screen, and players must sign the corresponding letter using American Sign Language to destroy them. The game explores the accuracy, responsiveness, and playfulness of sign recognition in dynamic environments. Built with MediaPipe, Matter.js, and p5.js and a pretrained model on python, it combines language, motion, and visual feedback to investigate how physical gestures can drive meaningful and intuitive digital interactions.
Open Studios
For Open Studios, I transformed my workspace into an exhibition area showcasing my final year project, Gestural Interactions. The setup included an interactive ASL learning game displayed on an iMac, a hand-controlled plotter mounted on the partition wall, and documentation of my earlier gesture-based experiments. I designed the space using wood and acrylic elements to create a clean, cohesive look, added laser-cut signage for the project title, and installed pedestals to organise different components. Over three days, I demonstrated the prototypes, shared the work with visitors from the public, industry, and the school community, and captured photographs and videos of people engaging with the installations.
