STAC: A comprehensive sensor fusion model for scene characterization

Zsolt Kira, Alan Richard Wagner, Chris Kennedy, Jason Zutty, Grady Tuell

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic information from a wide variety of sensors, but these advances have raised new challenges in fusing the data. For example, in developing fusion algorithms for moving target identification (MTI) applications, what is the best way to combine image data having different temporal frequencies, and how should we introduce contextual information acquired from monitoring cell phones or from human intelligence? In addressing these questions we have found that existing data fusion models do not readily facilitate comparison of fusion algorithms performing such complex information extraction, so we developed a new model that does. Here, we present the Spatial, Temporal, Algorithm, and Cognition (STAC) model. STAC allows for describing the progression of multi-sensor raw data through increasing levels of abstraction, and provides a way to easily compare fusion strategies. It provides for unambiguous description of how multi-sensor data are combined, the computational algorithms being used, and how scene understanding is ultimately achieved. In this paper, we describe and illustrate the STAC model, and compare it to other existing models.

Original languageEnglish (US)
Title of host publicationMultisensor, Multisource Information Fusion
Subtitle of host publicationArchitectures, Algorithms, and Applications 2015
EditorsJerome J. Braun
PublisherSPIE
ISBN (Electronic)9781628416145
DOIs
StatePublished - Jan 1 2015
EventMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015 - Baltimore, United States
Duration: Apr 21 2015 → …

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume9498
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Other

OtherMultisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015
CountryUnited States
CityBaltimore
Period4/21/15 → …

Fingerprint

cognition
Sensor Fusion
multisensor fusion
Cognition
Sensors
Fusion
Data Fusion
intelligence
fusion
Data fusion
sensors
Model
Target Identification
Moving Target
Information Extraction
Computational Algorithm
reconnaissance
semantics
Progression
Surveillance

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Kira, Z., Wagner, A. R., Kennedy, C., Zutty, J., & Tuell, G. (2015). STAC: A comprehensive sensor fusion model for scene characterization. In J. J. Braun (Ed.), Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015 [949804] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 9498). SPIE. https://doi.org/10.1117/12.2178494
Kira, Zsolt ; Wagner, Alan Richard ; Kennedy, Chris ; Zutty, Jason ; Tuell, Grady. / STAC : A comprehensive sensor fusion model for scene characterization. Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015. editor / Jerome J. Braun. SPIE, 2015. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{ff8ff7c02a824e4d9099f9edbfe2c782,
title = "STAC: A comprehensive sensor fusion model for scene characterization",
abstract = "We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic information from a wide variety of sensors, but these advances have raised new challenges in fusing the data. For example, in developing fusion algorithms for moving target identification (MTI) applications, what is the best way to combine image data having different temporal frequencies, and how should we introduce contextual information acquired from monitoring cell phones or from human intelligence? In addressing these questions we have found that existing data fusion models do not readily facilitate comparison of fusion algorithms performing such complex information extraction, so we developed a new model that does. Here, we present the Spatial, Temporal, Algorithm, and Cognition (STAC) model. STAC allows for describing the progression of multi-sensor raw data through increasing levels of abstraction, and provides a way to easily compare fusion strategies. It provides for unambiguous description of how multi-sensor data are combined, the computational algorithms being used, and how scene understanding is ultimately achieved. In this paper, we describe and illustrate the STAC model, and compare it to other existing models.",
author = "Zsolt Kira and Wagner, {Alan Richard} and Chris Kennedy and Jason Zutty and Grady Tuell",
year = "2015",
month = "1",
day = "1",
doi = "10.1117/12.2178494",
language = "English (US)",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "SPIE",
editor = "Braun, {Jerome J.}",
booktitle = "Multisensor, Multisource Information Fusion",
address = "United States",

}

Kira, Z, Wagner, AR, Kennedy, C, Zutty, J & Tuell, G 2015, STAC: A comprehensive sensor fusion model for scene characterization. in JJ Braun (ed.), Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015., 949804, Proceedings of SPIE - The International Society for Optical Engineering, vol. 9498, SPIE, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015, Baltimore, United States, 4/21/15. https://doi.org/10.1117/12.2178494

STAC : A comprehensive sensor fusion model for scene characterization. / Kira, Zsolt; Wagner, Alan Richard; Kennedy, Chris; Zutty, Jason; Tuell, Grady.

Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015. ed. / Jerome J. Braun. SPIE, 2015. 949804 (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 9498).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - STAC

T2 - A comprehensive sensor fusion model for scene characterization

AU - Kira, Zsolt

AU - Wagner, Alan Richard

AU - Kennedy, Chris

AU - Zutty, Jason

AU - Tuell, Grady

PY - 2015/1/1

Y1 - 2015/1/1

N2 - We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic information from a wide variety of sensors, but these advances have raised new challenges in fusing the data. For example, in developing fusion algorithms for moving target identification (MTI) applications, what is the best way to combine image data having different temporal frequencies, and how should we introduce contextual information acquired from monitoring cell phones or from human intelligence? In addressing these questions we have found that existing data fusion models do not readily facilitate comparison of fusion algorithms performing such complex information extraction, so we developed a new model that does. Here, we present the Spatial, Temporal, Algorithm, and Cognition (STAC) model. STAC allows for describing the progression of multi-sensor raw data through increasing levels of abstraction, and provides a way to easily compare fusion strategies. It provides for unambiguous description of how multi-sensor data are combined, the computational algorithms being used, and how scene understanding is ultimately achieved. In this paper, we describe and illustrate the STAC model, and compare it to other existing models.

AB - We are interested in data fusion strategies for Intelligence, Surveillance, and Reconnaissance (ISR) missions. Advances in theory, algorithms, and computational power have made it possible to extract rich semantic information from a wide variety of sensors, but these advances have raised new challenges in fusing the data. For example, in developing fusion algorithms for moving target identification (MTI) applications, what is the best way to combine image data having different temporal frequencies, and how should we introduce contextual information acquired from monitoring cell phones or from human intelligence? In addressing these questions we have found that existing data fusion models do not readily facilitate comparison of fusion algorithms performing such complex information extraction, so we developed a new model that does. Here, we present the Spatial, Temporal, Algorithm, and Cognition (STAC) model. STAC allows for describing the progression of multi-sensor raw data through increasing levels of abstraction, and provides a way to easily compare fusion strategies. It provides for unambiguous description of how multi-sensor data are combined, the computational algorithms being used, and how scene understanding is ultimately achieved. In this paper, we describe and illustrate the STAC model, and compare it to other existing models.

UR - http://www.scopus.com/inward/record.url?scp=84938885013&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84938885013&partnerID=8YFLogxK

U2 - 10.1117/12.2178494

DO - 10.1117/12.2178494

M3 - Conference contribution

AN - SCOPUS:84938885013

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Multisensor, Multisource Information Fusion

A2 - Braun, Jerome J.

PB - SPIE

ER -

Kira Z, Wagner AR, Kennedy C, Zutty J, Tuell G. STAC: A comprehensive sensor fusion model for scene characterization. In Braun JJ, editor, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2015. SPIE. 2015. 949804. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.2178494