University of Notre Dame
Browse

Longitudinal Audio Data Collection and Emotional Analysis in the SCALE System Framework

Download (1.34 MB)
thesis
posted on 2015-12-03, 00:00 authored by Rachael A. Purta

In the past decade, the number of people owning smartphones has increased rapidly, and the computational power and number of sensors available on these smartphones has increased as well. This growth has allowed the rise of research that uses the smartphone to measure various aspects of daily life, including social aspects like emotion in spoken communication. Sensing emotion from speech, however, is a challenging task which is only intensified when done on audio collected from a smartphone, and is further complicated when the sensing must be done over a long period of time, such as a longitudinal study. This thesis describes the Speech Collection and Analysis of Longitudinal Emotion (SCALE) system, which is designed to address such challenges for a scalable number of users over a long period of time. The system involves both a mobile client for the smartphone and a back-end server and analysis process meant for analyzing and storing the audio features essential to emotion recognition. In this thesis, the SCALE system design will be discussed, evaluated for performance, and potential methods for assessing emotion will be presented.

History

Date Modified

2017-06-05

Research Director(s)

Aaron Striegel

Committee Members

Dong Wang Sidney D'Mello

Degree

  • Master of Science in Computer Science and Engineering

Degree Level

  • Master's Thesis

Additional Groups

  • Computer Science and Engineering

Program Name

  • Computer Science and Engineering

Usage metrics

    Masters Theses

    Categories

    No categories selected

    Keywords

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC