Title:
|
On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makam music
|
Author:
|
Dzhambazov, Georgi Bogomilov; Srinivasamurthy, Ajay; Sentürk, Sertan; Serra, Xavier
|
Abstract:
|
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA. |
Abstract:
|
Lyrics-to-audio alignment aims to automatically match
given lyrics and musical audio. In this work we extend a
state of the art approach for lyrics-to-audio alignment with
information about note onsets. In particular, we consider
the fact that transition to next lyrics syllable usually implies
transition to a new musical note. To this end we formulate
rules that guide the transition between consecutive
phonemes when a note onset is present. These rules are incorporated
into the transition matrix of a variable-time hidden
Markov model (VTHMM) phonetic recognizer based
on MFCCs. An estimated melodic contour is input to
an automatic note transcription algorithm, from which the
note onsets are derived. The proposed approach is evaluated
on 12 a cappella audio recordings of Turkish Makam
music using a phrase-level accuracy measure. Evaluation
of the alignment is also presented on a polyphonic version
of the dataset in order to assess how degradation in the extracted
onsets affects performance. Results show that the
proposed model outperforms a baseline approach unaware
of onset transition rules. To the best of our knowledge, this
is the one of the first approaches tackling lyrics tracking,
which combines timbral features with a melodic feature in
the alignment process itself. |
Abstract:
|
This work is partly supported by the European Research Council under the European Union’s Seventh Framework Program, as part of the CompMusic project (ERC grant agreement 267583) and partly by the AGAUR research grant. We acknowledge as well financial support from the Spanish Ministry of Economy and Competitiveness, through the ”María de Maeztu” Programme for Centres/Units of Excellence in R&D” (MDM-2015-0502). |
Subject(s):
|
-Música -- Anàlisi |
Rights:
|
© Georgi Dzhambazov, Ajay Srinivasamurthy, Sertan Senturk , Xavier Serra . Licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0). Attribution: Georgi Dzhambazov, Ajay Srinivasamurthy, Sertan Senturk , Xavier Serra. “On the use of note onsets for improved lyrics-to-audio alignment in Turkish Makammusic”, 17th International Society for Music Information Retrieval Conference, 2016.
http://creativecommons.org/licenses/by/4.0/ |
Document type:
|
Conference Object Article - Published version |
Published by:
|
International Society for Music Information Retrieval (ISMIR)
|
Share:
|
|