Wearable Sensor Glove for Music Control

The accessibility of music production has increased with free software, but novices often struggle with software and technical terms, while the traditional mouse-based workflow can hinder creativity. This research aims to streamline music production by integrating haptic technology, allowing for intuitive application of audio effects with hand gestures.

The project focuses on leveraging various haptic sensors, such as flex sensors and IMUs, to enhance both the immersiveness and control of musical performance and effects. These immersive experiences not only empower artists to express themselves in new ways but also deepen audience engagement for memorable experiences.

Our gloves have multiple sensors to capture real-time data, which is then fed through Arduino to Max MSP to apply audio effects. Our goal is to present a live musical performance using these innovative gloves, potentially revolutionizing music production.

This project effectively brings together the 3 areas of concentration, Mechanical Engineering, Computer Science and Music Technology, by integrating sensor technology with software development in the realm of music parameter control.

Through this project a few insights were gained:

1. How sensor technologies can be practically applied in real-world scenarios, particularly in the context of wearable devices and human-computer interaction.
2. The importance of interdisciplinary collaboration and communication in addressing complex challenges, where expertise from multiple domains is essential for project success.
3. Problem-solving skills during sensor selection, hardware implementation, software development and system integration.
4. Understanding the iterative nature of engineering and software development, where plans evolve through constraints, feedback and additional ideas.

This project was made possible with support from FRFF Grant #2024-33. Additional images can be found here.