Beyond visualization of big data

A multi-stage data exploration approach using visualization, sonification, and storification

Jeffrey Rimland, Mark Edward Ballora, Wade Shumaker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

As the sheer volume of data grows exponentially, it becomes increasingly difficult for existing visualization techniques to keep pace. The sonification field attempts to address this issue by enlisting our auditory senses to detect anomalies or complex events that are difficult to detect via visualization alone. Storification attempts to improve analyst understanding by converting data streams into organized narratives describing the data at a higher level of abstraction than the input stream that they area derived from. While these techniques hold a great deal of promise, they also each have a unique set of challenges that must be overcome. Sonification techniques must represent a broad variety of distributed heterogeneous data and present it to the analyst/listener in a manner that doesn't require extended listening - as visual "snapshots" are useful but auditory sounds only exist over time. Storification still faces many human-computer interface (HCI) challenges as well as technical hurdles related to automatically generating a logical narrative from lower-level data streams. This paper proposes a novel approach that utilizes a service oriented architecture (SOA)-based hybrid visualization/ sonification/storification framework to enable distributed human-in-the-loop processing of data in a manner that makes optimized usage of both visual and auditory processing pathways while also leveraging the value of narrative explication of data streams. It addresses the benefits and shortcomings of each processing modality and discusses information infrastructure and data representation concerns required with their utilization in a distributed environment. We present a generalizable approach with a broad range of applications including cyber security, medical informatics, facilitation of energy savings in "smart" buildings, and detection of natural and man-made disasters.

Original languageEnglish (US)
Title of host publicationNext-Generation Analyst
Volume8758
DOIs
StatePublished - Aug 12 2013
EventNext-Generation Analyst - Baltimore, MD, United States
Duration: Apr 29 2013Apr 30 2013

Other

OtherNext-Generation Analyst
CountryUnited States
CityBaltimore, MD
Period4/29/134/30/13

Fingerprint

Sonification
Visualization
Data Streams
Processing
Intelligent buildings
human-computer interface
service oriented architecture
Service oriented architecture (SOA)
Disasters
Interfaces (computer)
Medical Informatics
disasters
Energy conservation
Human-computer Interface
Acoustic waves
Snapshot
Distributed Environment
Service-oriented Architecture
Energy Saving
Disaster

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Rimland, Jeffrey ; Ballora, Mark Edward ; Shumaker, Wade. / Beyond visualization of big data : A multi-stage data exploration approach using visualization, sonification, and storification. Next-Generation Analyst. Vol. 8758 2013.
@inproceedings{f615ef112eb54fda88a52960e258eb73,
title = "Beyond visualization of big data: A multi-stage data exploration approach using visualization, sonification, and storification",
abstract = "As the sheer volume of data grows exponentially, it becomes increasingly difficult for existing visualization techniques to keep pace. The sonification field attempts to address this issue by enlisting our auditory senses to detect anomalies or complex events that are difficult to detect via visualization alone. Storification attempts to improve analyst understanding by converting data streams into organized narratives describing the data at a higher level of abstraction than the input stream that they area derived from. While these techniques hold a great deal of promise, they also each have a unique set of challenges that must be overcome. Sonification techniques must represent a broad variety of distributed heterogeneous data and present it to the analyst/listener in a manner that doesn't require extended listening - as visual {"}snapshots{"} are useful but auditory sounds only exist over time. Storification still faces many human-computer interface (HCI) challenges as well as technical hurdles related to automatically generating a logical narrative from lower-level data streams. This paper proposes a novel approach that utilizes a service oriented architecture (SOA)-based hybrid visualization/ sonification/storification framework to enable distributed human-in-the-loop processing of data in a manner that makes optimized usage of both visual and auditory processing pathways while also leveraging the value of narrative explication of data streams. It addresses the benefits and shortcomings of each processing modality and discusses information infrastructure and data representation concerns required with their utilization in a distributed environment. We present a generalizable approach with a broad range of applications including cyber security, medical informatics, facilitation of energy savings in {"}smart{"} buildings, and detection of natural and man-made disasters.",
author = "Jeffrey Rimland and Ballora, {Mark Edward} and Wade Shumaker",
year = "2013",
month = "8",
day = "12",
doi = "10.1117/12.2016019",
language = "English (US)",
isbn = "9780819495495",
volume = "8758",
booktitle = "Next-Generation Analyst",

}

Rimland, J, Ballora, ME & Shumaker, W 2013, Beyond visualization of big data: A multi-stage data exploration approach using visualization, sonification, and storification. in Next-Generation Analyst. vol. 8758, 87580K, Next-Generation Analyst, Baltimore, MD, United States, 4/29/13. https://doi.org/10.1117/12.2016019

Beyond visualization of big data : A multi-stage data exploration approach using visualization, sonification, and storification. / Rimland, Jeffrey; Ballora, Mark Edward; Shumaker, Wade.

Next-Generation Analyst. Vol. 8758 2013. 87580K.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Beyond visualization of big data

T2 - A multi-stage data exploration approach using visualization, sonification, and storification

AU - Rimland, Jeffrey

AU - Ballora, Mark Edward

AU - Shumaker, Wade

PY - 2013/8/12

Y1 - 2013/8/12

N2 - As the sheer volume of data grows exponentially, it becomes increasingly difficult for existing visualization techniques to keep pace. The sonification field attempts to address this issue by enlisting our auditory senses to detect anomalies or complex events that are difficult to detect via visualization alone. Storification attempts to improve analyst understanding by converting data streams into organized narratives describing the data at a higher level of abstraction than the input stream that they area derived from. While these techniques hold a great deal of promise, they also each have a unique set of challenges that must be overcome. Sonification techniques must represent a broad variety of distributed heterogeneous data and present it to the analyst/listener in a manner that doesn't require extended listening - as visual "snapshots" are useful but auditory sounds only exist over time. Storification still faces many human-computer interface (HCI) challenges as well as technical hurdles related to automatically generating a logical narrative from lower-level data streams. This paper proposes a novel approach that utilizes a service oriented architecture (SOA)-based hybrid visualization/ sonification/storification framework to enable distributed human-in-the-loop processing of data in a manner that makes optimized usage of both visual and auditory processing pathways while also leveraging the value of narrative explication of data streams. It addresses the benefits and shortcomings of each processing modality and discusses information infrastructure and data representation concerns required with their utilization in a distributed environment. We present a generalizable approach with a broad range of applications including cyber security, medical informatics, facilitation of energy savings in "smart" buildings, and detection of natural and man-made disasters.

AB - As the sheer volume of data grows exponentially, it becomes increasingly difficult for existing visualization techniques to keep pace. The sonification field attempts to address this issue by enlisting our auditory senses to detect anomalies or complex events that are difficult to detect via visualization alone. Storification attempts to improve analyst understanding by converting data streams into organized narratives describing the data at a higher level of abstraction than the input stream that they area derived from. While these techniques hold a great deal of promise, they also each have a unique set of challenges that must be overcome. Sonification techniques must represent a broad variety of distributed heterogeneous data and present it to the analyst/listener in a manner that doesn't require extended listening - as visual "snapshots" are useful but auditory sounds only exist over time. Storification still faces many human-computer interface (HCI) challenges as well as technical hurdles related to automatically generating a logical narrative from lower-level data streams. This paper proposes a novel approach that utilizes a service oriented architecture (SOA)-based hybrid visualization/ sonification/storification framework to enable distributed human-in-the-loop processing of data in a manner that makes optimized usage of both visual and auditory processing pathways while also leveraging the value of narrative explication of data streams. It addresses the benefits and shortcomings of each processing modality and discusses information infrastructure and data representation concerns required with their utilization in a distributed environment. We present a generalizable approach with a broad range of applications including cyber security, medical informatics, facilitation of energy savings in "smart" buildings, and detection of natural and man-made disasters.

UR - http://www.scopus.com/inward/record.url?scp=84881168797&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881168797&partnerID=8YFLogxK

U2 - 10.1117/12.2016019

DO - 10.1117/12.2016019

M3 - Conference contribution

SN - 9780819495495

VL - 8758

BT - Next-Generation Analyst

ER -