Inchworm Team 2019
James Hoder, Joseph Meng
Audio-Capturing Music Notation System
The goal of this project was to develop a system that could automatically notate music played by a single instrument using a microphone array and digital signal processing (DSP). Notating music while composing can severely disrupt the creative process – writing music down can be very difficult and distracting, especially for amateur composers. This system was built to allow users to play new compositions without restriction. The system records what the user plays, then immediately displays a saved, notated version on a screen to be reviewed afterward. Composers can use this system to remember what they have played and, thereby, write sheet music or MIDI files based on their uninterrupted compositions.
This project was implemented completely on a RaspberryPi using Python software and the Respeaker Microphone Array. Audio input was recorded using the Respeaker, then loaded into Python. The Python code then found the frequency and duration of each note using numerous time-limited Fast Fourier Transform (FFT) frequency analyses of the recording. The frequencies found for each note were then compared to a dataset of known notes, qualified by their duration, and displayed on a user-friendly GUI. The microphone array was used in order to provide a clean and easily usable audio input, and the DSP was done primarily using the FFT to identify the correct notes. The resulting product allowed users to simply click start before they begin playing, click stop when they finish playing, and then see and hear their full composition afterward.
Related Tech Notes
- Microphone Arrays for Audio Enhancement by James Hoder
- Digital Signal Processing & Machine Learning Combination for Audio Detection by Joseph Meng
Inchworm Team Project Poster
- Senior Capstone Projects Summary for the 2018-19 Academic Year > Inchworm Team 2019
Search the Handbook:
Handbook Overview
- Introduction and Acknowledgements
- Senior Capstone Projects Summary for the 2022-23 Academic Year
- Senior Capstone Projects Summary for the 2021-22 Academic Year
- Senior Capstone Projects Summary for the 2020-21 Academic Year
- Senior Capstone Projects Summary for the 2019-20 Academic Year
- Senior Capstone Projects Summary for the 2018-19 Academic Year
- Senior Capstone Projects Summary for the 2017-18 Academic Year
- Senior Capstone Projects Summary for the 2016-17 Academic Year
- Senior Capstone Projects Summary for the 2015-16 Academic Year
- Senior Capstone Projects Summary for the 2014-15 Academic Year
- Senior Capstone Projects Summary for the 2013-14 Academic Year
- Senior Capstone Projects Summary for the 2012-13 Academic Year
- 1. Design Process
- 2. Management
- 3. Technologies
- 4. Communications And Life Skills
- 5. Tech Notes
Top Topics
Apple iPhone Assistive Technologies Big Data Bridge Inspection Business Strategy Communications Computer Vision Consumer Technologies Cough detection Creativity & Innovation Data Analysis Design for X Emergency resource management Emerging Technologies Encryption Engineering Economics Ethics GPS Indoor Navigation Industrial Technologies Internet of Things Interpersonal Skills Legal & Intellectual Property Marketing & Customer Research Mobile Applications OpenCV Product Development Life Cycle Product Liability Prototyping & Manufacturing Recommender System Remote Keyless Entry Risk Risk Management Security Sensors Signal Processing Societal Impact Synthetic Aperture Radar Tuberculosis UAV Drones UAV Motion Unmanned Technologies Virtual Reality Visual Impairment Wireless