University of Notre Dame
Browse

Simultaneous Analysis of Verbal and Nonverbal Data During Conversation: Symmetry and Turn-taking

Download (2.23 MB)
thesis
posted on 2011-06-01, 00:00 authored by Kathleen Targowski Ashenfelter
This dissertation examines coordinated verbal and nonverbal symmetry in turn-taking behavior during conversation using three modern techniques for analyzing conversational data in nonstationary time series data: windowed cross-correlation, multifractal wavelet analysis, and recurrence quantification analysis. A major goal of this work was to combine the well-established qualitative method of analyzing verbal (and more recently nonverbal) discourse known as conversation analysis (CA) with more recent quantitative methods for analyzing nonstationary time series data. Windowed-cross correlation (WCC) was used to estimate the degree of relationship between head position and speech output within one participant as well as the degree of (verbal and nonverbal) correlation between participants using a correlation matrix-based approach. The multifractal wavelet analysis called wavelet transform modulus maxima (WTMM) examined the underlying structure of each data series including fractal dimension and the Holder exponent. Recurrence quantification analysis (RQA) and cross-recurrence quantification (CRQ) were used to investigate the phase space of each time series, further examining mirroring in verbal and nonverbal behavior (e.g., recurrences) within and between participants at the point where turn-taking occurs during conversation. These three analyses are appropriate human conversation data that is likely to be nonstationary because WTMM, RQA, and CRQ are nonparametric and WCC assumes only local stationarity (about 2 seconds). The two major goals of these analyses were to: 1) perform these three analyses to examine the relationship between an individual participant's verbal and nonverbal data and the relationship between two people's verbal or nonverbal data with a focus on the phenomenon of conversational turn-taking and, 2) estimate the predictability of the outcome of each of these three analyses based on gender and dominance were calculated. Finally, in order to demonstrate the real-world applicability of these analyses, the original digitized video of a conversation at salient time segments identified by the RQA/CRQA analyses were transcribed as an illustration of the practical meaning of the analyses using QuickTime (Apple Computers, 1991-2007) to compare to CA transcriptions and plots of the time series data.

History

Date Modified

2017-06-05

Defense Date

2007-04-13

Research Director(s)

Steven Boker

Committee Members

Darcia Narvaez Sy-Miin Chow Ke-Hai Yuan

Degree

  • Doctor of Philosophy

Degree Level

  • Doctoral Dissertation

Language

  • English

Alternate Identifier

etd-06012011-161332

Publisher

University of Notre Dame

Program Name

  • Psychology

Usage metrics

    Dissertations

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC