Skoči na glavni sadržaj

Pregledni rad

https://doi.org/10.31299/hrri.58.si.13

EEG analysis based on dynamic visual stimuli: best practices in analysis of sign language data

Julia Krebs ; University of Salzburg, Department of Linguistics, Centre for Cognitive Neuroscience (CCNS), Erzabt-Klotz-Straße 1, Salzburg, Austria
Evie Malaia ; University of Alabama, Department of Communicative Disorders, Tuscaloosa, Alabama, United States
Ronnie B. Wilbur ; Purdue University, Department of Linguistics, and Department of Speech, Language, and Hearing Sciences, Lyles-Porter Hall, West Lafayette, Indiana, United States
Dietmar Roehm ; University of Salzburg, Department of Linguistics, Centre for Cognitive Neuroscience (CCNS), Erzabt-Klotz-Straße 1, Salzburg, Austria


Puni tekst: engleski pdf 2.888 Kb

str. 245-266

preuzimanja: 358

citiraj


Sažetak

This paper reviews best practices for experimental design and analysis for sign language research using neurophysiological methods, such as electroencephalography (EEG) and other methods with high temporal resolution, as well as identifies methodological challenges in neurophysiological research on natural sign language processing. In particular, we outline the considerations for generating linguistically and physically well-controlled stimuli accounting for 1) the layering of manual and non-manual information at different timescales, 2) possible unknown linguistic and non-linguistic visual cues that can affect processing, 3) variability across linguistic stimuli, and 4) predictive processing. Two specific concerns with regard to the analysis and interpretation of observed event related potential (ERP) effects for dynamic stimuli are discussed in detail. First, we discuss the “trigger/effect assignment problem”, which describes the difficulty of determining the time point for calculating ERPs. This issue is related to the problem of determining the onset of a critical sign (i.e., stimulus onset time), and the lack of clarity as to how the border between lexical (sign) and transitional movement (motion trajectory between individual signs) should be defined. Second, we discuss possible differences in the dynamics within signing that might influence ERP patterns and should be controlled for when creating natural sign language material for ERP studies. In addition, we outline alternative approaches to EEG data analyses for natural signing stimuli, such as the timestamping of continuous EEG with trigger markers for each potentially relevant cue in dynamic stimuli. Throughout the discussion, we present empirical evidence for the need to account for dynamic, multi-channel, and multi-timescale visual signal that characterizes sign languages in order to ensure the ecological validity of neurophysiological research in sign languages.

Ključne riječi

sign language; ERP methodology; simultaneity; dynamic visual stimuli

Hrčak ID:

284347

URI

https://hrcak.srce.hr/284347

Datum izdavanja:

12.10.2022.

Posjeta: 716 *