Please use this identifier to cite or link to this item: http://hdl.handle.net/2122/14837
Authors: Paté, Arthur* 
Farge, Gaspard* 
Holtzman, Benjamin K* 
Barth, Anna C* 
Poli, Piero* 
Boschi, Lapo* 
Karlstrom, Leif* 
Title: Combining audio and visual displays to highlight temporal and spatial seismic patterns
Journal: Journal on Multimodal User Interfaces 
Series/Report no.: /16 (2022)
Publisher: Springer Nature
Issue Date: 2022
DOI: 10.1007/s12193-021-00378-8
Subject Classification04.06. Seismology
Abstract: Data visualization, and to a lesser extent data sonification, are classic tools to the scientific community. However, these two approaches are very rarely combined, although they are highly complementary: our visual system is good at recognizing spatial patterns, whereas our auditory system is better tuned for temporal patterns. In this article, data representation methods are proposed that combine visualization, sonification, and spatial audio techniques, in order to optimize the user’s perception of spatial and temporal patterns in a single display, to increase the feeling of immersion, and to take advantage of multimodal integration mechanisms. Three seismic data sets are used to illustrate the methods, covering different physical phenomena, time scales, spatial distributions, and spatio-temporal dynamics. The methods are adapted to the specificities of each data set, and to the amount of information that the designer wants to display. This leads to further developments, namely the use of audification with two time scales, the switch from pure audification to time-modulated noise, and the switch from pure audification to sonic icons. First user feedback from live demonstrations indicates that the methods presented in this article seem to enhance the perception of spatio-temporal patterns, which is a key parameter to the understanding of seismically active systems, and a step towards apprehending the processes that drive this activity.
Appears in Collections:Article published / in press

Files in This Item:
File Description SizeFormat Existing users please Login
10.1007@s12193-021-00378-8.pdfrestricted paper2.98 MBAdobe PDF
Show full item record

Page view(s)

36
checked on Mar 27, 2024

Download(s)

1
checked on Mar 27, 2024

Google ScholarTM

Check

Altmetric