MIT EECS | CS+HASS Undergraduate Research and Innovation Scholar
Real-Time Audio Synchronization
Leslie P. Kaelbling
ConcertCue brings the traditional music program to life: it is a real-time program web application for concerts. Users are provided relevant information at precisely timed moments of a live performance, thus enhancing the concert. Currently, these timed moments are manually synchronized during a concert. This project will focus on adding automatic synchronization of live music to the prerecorded annotated music. The typical approach to synchronizing two pieces of music Dynamic Time Warping (DTW) is offline requiring all audio data a priori. However, as we need real-time synchronization, the goal of this project is to create a real-time variant of DTW. I will analyze the performance of the current variants, develop other techniques, and identify the best approach to take in the end.
“This project embodies what I love about computer science — its interdisciplinary nature — and combines with another passion: music. I have studied some basics of signal processing, and I am excited about this opportunity to learn more about it and related topics through my SuperUROP project. It will also be a wonderful way to explore the intersection of music and technology, particularly how we can use technology to improve our musical experiences.”