Use of sonification in the detection of anomalous events

Mark Edward Ballora, Robert J. Cole, Heidi Kruesi, Herbert Greene, Ganesh Mohanan, David L. Hall

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this paper, we describe the construction of a soundtrack that fuses stock market data with information taken from tweets. This soundtrack, or auditory display, presents the numerical and text data in such a way that anomalous events may be readily detected, even by untrained listeners. The soundtrack generation is flexible, allowing an individual listener to create a unique audio mix from the available information sources. Properly constructed, the display exploits the auditory system's sensitivities to periodicities, to dynamic changes, and to patterns. This type of display could be valuable in environments that demand high levels of situational awareness based on multiple sources of incoming information.

Original languageEnglish (US)
Title of host publicationMultisensor, Multisource Information Fusion
Subtitle of host publicationArchitectures, Algorithms, and Applications 2012
Volume8407
DOIs
StatePublished - Dec 3 2012
EventMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012 - Baltimore, MD, United States
Duration: Apr 25 2012Apr 26 2012

Other

OtherMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012
CountryUnited States
CityBaltimore, MD
Period4/25/124/26/12

Fingerprint

Sonification
Anomalous
Display
Display devices
situational awareness
Situational Awareness
fuses
Electric fuses
Stock Market
Periodicity
periodic variations
sensitivity

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Ballora, M. E., Cole, R. J., Kruesi, H., Greene, H., Mohanan, G., & Hall, D. L. (2012). Use of sonification in the detection of anomalous events. In Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012 (Vol. 8407). [84070S] https://doi.org/10.1117/12.918688
Ballora, Mark Edward ; Cole, Robert J. ; Kruesi, Heidi ; Greene, Herbert ; Mohanan, Ganesh ; Hall, David L. / Use of sonification in the detection of anomalous events. Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012. Vol. 8407 2012.
@inproceedings{3a83ab10168842d1b285bac9b572b5e8,
title = "Use of sonification in the detection of anomalous events",
abstract = "In this paper, we describe the construction of a soundtrack that fuses stock market data with information taken from tweets. This soundtrack, or auditory display, presents the numerical and text data in such a way that anomalous events may be readily detected, even by untrained listeners. The soundtrack generation is flexible, allowing an individual listener to create a unique audio mix from the available information sources. Properly constructed, the display exploits the auditory system's sensitivities to periodicities, to dynamic changes, and to patterns. This type of display could be valuable in environments that demand high levels of situational awareness based on multiple sources of incoming information.",
author = "Ballora, {Mark Edward} and Cole, {Robert J.} and Heidi Kruesi and Herbert Greene and Ganesh Mohanan and Hall, {David L.}",
year = "2012",
month = "12",
day = "3",
doi = "10.1117/12.918688",
language = "English (US)",
isbn = "9780819490858",
volume = "8407",
booktitle = "Multisensor, Multisource Information Fusion",

}

Ballora, ME, Cole, RJ, Kruesi, H, Greene, H, Mohanan, G & Hall, DL 2012, Use of sonification in the detection of anomalous events. in Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012. vol. 8407, 84070S, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012, Baltimore, MD, United States, 4/25/12. https://doi.org/10.1117/12.918688

Use of sonification in the detection of anomalous events. / Ballora, Mark Edward; Cole, Robert J.; Kruesi, Heidi; Greene, Herbert; Mohanan, Ganesh; Hall, David L.

Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012. Vol. 8407 2012. 84070S.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Use of sonification in the detection of anomalous events

AU - Ballora, Mark Edward

AU - Cole, Robert J.

AU - Kruesi, Heidi

AU - Greene, Herbert

AU - Mohanan, Ganesh

AU - Hall, David L.

PY - 2012/12/3

Y1 - 2012/12/3

N2 - In this paper, we describe the construction of a soundtrack that fuses stock market data with information taken from tweets. This soundtrack, or auditory display, presents the numerical and text data in such a way that anomalous events may be readily detected, even by untrained listeners. The soundtrack generation is flexible, allowing an individual listener to create a unique audio mix from the available information sources. Properly constructed, the display exploits the auditory system's sensitivities to periodicities, to dynamic changes, and to patterns. This type of display could be valuable in environments that demand high levels of situational awareness based on multiple sources of incoming information.

AB - In this paper, we describe the construction of a soundtrack that fuses stock market data with information taken from tweets. This soundtrack, or auditory display, presents the numerical and text data in such a way that anomalous events may be readily detected, even by untrained listeners. The soundtrack generation is flexible, allowing an individual listener to create a unique audio mix from the available information sources. Properly constructed, the display exploits the auditory system's sensitivities to periodicities, to dynamic changes, and to patterns. This type of display could be valuable in environments that demand high levels of situational awareness based on multiple sources of incoming information.

UR - http://www.scopus.com/inward/record.url?scp=84870156666&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870156666&partnerID=8YFLogxK

U2 - 10.1117/12.918688

DO - 10.1117/12.918688

M3 - Conference contribution

AN - SCOPUS:84870156666

SN - 9780819490858

VL - 8407

BT - Multisensor, Multisource Information Fusion

ER -

Ballora ME, Cole RJ, Kruesi H, Greene H, Mohanan G, Hall DL. Use of sonification in the detection of anomalous events. In Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2012. Vol. 8407. 2012. 84070S https://doi.org/10.1117/12.918688