Publication Details

Download

Yong Ma, Jingyi Li, Heiko Drewes, Andreas Butz
You Sound Relaxed Now - Measuring Restorative Effects from Speech Signals
In: 18th IFIP TC13 International Conference On Human-Computer interaction (INTERACT 2021), August 30th-September 3rd (bib)

The recently proposed restorative environments have the potential to restore attention and help against fatigue, but how can these effects be verified? We present a novel measurement method that can analyze participants′ speech signals in a study before and after they experience an in-car restorative environment in VR. Compared to other measurements such as attention scales or response tests, speech signal analysis is both less obtrusive and more accessible. In our study, we found that certain time- and frequency-domain speech features such as short-time energy and Mel Frequency Cepstral Coefficients (MFCC) are correlated with the attentional capacity measured by subjective ratings. We thus argue that speech signal analysis can provide a valid measure for attention and its restoration. We describe a practically feasible method for such a speech signal analysis along with some preliminary results.