• search hit 2 of 16
Back to Result List

AI Generated Music Using Speech Emotion Recognition

  • This study aims to compare two different implementations of speech emotion recognition models.The emphasis is directed towards evaluating their efficacy in capturing and characterizing dialogues portrayed by actors within a film scene to create suitable musical intervals. The goal of the overarching research intends to derive indications to enhance the compositional process of film scores by recognizing the emotion in a particular scene. Based on established deep learning models, the study delves into the exploration of two distinct emotion classification metrics: The Six Emotion Prediction and the Valence/Arousal/Dominance Prediction. To facilitate a comparative analysis, a preliminary study an a following survey is deployed. The preliminary study confirms a significant difference in the generated MIDI data. For this reason, a survey is essential to detect the better fitting algorithm. Participants are tasked to rate the affective suitability of eight generated interval sequences to the corresponding film scenes. The Suitability isThis study aims to compare two different implementations of speech emotion recognition models.The emphasis is directed towards evaluating their efficacy in capturing and characterizing dialogues portrayed by actors within a film scene to create suitable musical intervals. The goal of the overarching research intends to derive indications to enhance the compositional process of film scores by recognizing the emotion in a particular scene. Based on established deep learning models, the study delves into the exploration of two distinct emotion classification metrics: The Six Emotion Prediction and the Valence/Arousal/Dominance Prediction. To facilitate a comparative analysis, a preliminary study an a following survey is deployed. The preliminary study confirms a significant difference in the generated MIDI data. For this reason, a survey is essential to detect the better fitting algorithm. Participants are tasked to rate the affective suitability of eight generated interval sequences to the corresponding film scenes. The Suitability is verified quantitatively using a bidirectional rating system. Both model assessments are conducted within a uniform sound design, thus ensuring unbiased conditions for evaluation. Upon a thorough examination of our extensive analysis, a preference for method A becomes increasingly evident.show moreshow less

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Roberto MurruORCiD, Jonas KrugORCiD, Tom SchmidORCiD, Garri StebaORCiD, Giorgio GiacintoORCiD, Alexander von HoffmannORCiD
URN:urn:nbn:de:bvb:92-opus4-12016
DOI:https://doi.org/10.34646/thn/ohmdok-1201
Document Type:Working Paper
Language:English
Date of first Publication:2023/11/21
Publishing Institution:Technische Hochschule Nürnberg Georg Simon Ohm
Release Date:2023/11/22
Pagenumber:9
First Page:1
Last Page:9
institutes:Fakultät für Elektrotechnik Feinwerktechnik Informationstechnik
Licence (German):Creative Commons - CC BY-NC-ND - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.