A multi-modality attributes representation scheme for Group Activity characterization and data fusion

Vinayak Elangovan, Amjad Alkilani, Amir Shirkhodaie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

Proper characterization of human Group Activity (GA) interactions can help to detect and prevent certain pertinent threats efficiently. In this paper, we present a model-based scheme for robust group activity characterization. The proposed approach takes advantage of synergy of multi-sensors data to track and identify key individual and group activity events based on fusion of imagery and acoustic sensors data. Each activity event is attributed by a set of tagged features. By matching and correlating attributes of events, the model attempts to associate sensory observations to a priori known ontology. The proposed model benefits from a fusion process that achieves perceptual grouping of activities by spatiotemporal correlation and association of fragmented perceptions extracted from attributed events. In this paper, we present the results of our experimental work and demonstrate the effective and robustness of the decision fusion technique in terms of properly classifying group activities and generating semantic messages describing dynamics of human group activities that, in turn, improves situational awareness.

Original languageEnglish (US)
Title of host publicationIEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics
Subtitle of host publicationBig Data, Emergent Threats, and Decision-Making in Security Informatics
Pages85-90
Number of pages6
DOIs
StatePublished - Sep 9 2013
Event11th IEEE International Conference on Intelligence and Security Informatics, IEEE ISI 2013 - Seattle, WA, United States
Duration: Jun 4 2013Jun 7 2013

Publication series

NameIEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics

Other

Other11th IEEE International Conference on Intelligence and Security Informatics, IEEE ISI 2013
CountryUnited States
CitySeattle, WA
Period6/4/136/7/13

Fingerprint

Data fusion
Sensors
Ontology
Acoustics
Semantics

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Information Systems

Cite this

Elangovan, V., Alkilani, A., & Shirkhodaie, A. (2013). A multi-modality attributes representation scheme for Group Activity characterization and data fusion. In IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics (pp. 85-90). [6578792] (IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics). https://doi.org/10.1109/ISI.2013.6578792
Elangovan, Vinayak ; Alkilani, Amjad ; Shirkhodaie, Amir. / A multi-modality attributes representation scheme for Group Activity characterization and data fusion. IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics. 2013. pp. 85-90 (IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics).
@inproceedings{b40c6398434b41d39f8f81e5aa25b336,
title = "A multi-modality attributes representation scheme for Group Activity characterization and data fusion",
abstract = "Proper characterization of human Group Activity (GA) interactions can help to detect and prevent certain pertinent threats efficiently. In this paper, we present a model-based scheme for robust group activity characterization. The proposed approach takes advantage of synergy of multi-sensors data to track and identify key individual and group activity events based on fusion of imagery and acoustic sensors data. Each activity event is attributed by a set of tagged features. By matching and correlating attributes of events, the model attempts to associate sensory observations to a priori known ontology. The proposed model benefits from a fusion process that achieves perceptual grouping of activities by spatiotemporal correlation and association of fragmented perceptions extracted from attributed events. In this paper, we present the results of our experimental work and demonstrate the effective and robustness of the decision fusion technique in terms of properly classifying group activities and generating semantic messages describing dynamics of human group activities that, in turn, improves situational awareness.",
author = "Vinayak Elangovan and Amjad Alkilani and Amir Shirkhodaie",
year = "2013",
month = "9",
day = "9",
doi = "10.1109/ISI.2013.6578792",
language = "English (US)",
isbn = "9781467362115",
series = "IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics",
pages = "85--90",
booktitle = "IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics",

}

Elangovan, V, Alkilani, A & Shirkhodaie, A 2013, A multi-modality attributes representation scheme for Group Activity characterization and data fusion. in IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics., 6578792, IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics, pp. 85-90, 11th IEEE International Conference on Intelligence and Security Informatics, IEEE ISI 2013, Seattle, WA, United States, 6/4/13. https://doi.org/10.1109/ISI.2013.6578792

A multi-modality attributes representation scheme for Group Activity characterization and data fusion. / Elangovan, Vinayak; Alkilani, Amjad; Shirkhodaie, Amir.

IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics. 2013. p. 85-90 6578792 (IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A multi-modality attributes representation scheme for Group Activity characterization and data fusion

AU - Elangovan, Vinayak

AU - Alkilani, Amjad

AU - Shirkhodaie, Amir

PY - 2013/9/9

Y1 - 2013/9/9

N2 - Proper characterization of human Group Activity (GA) interactions can help to detect and prevent certain pertinent threats efficiently. In this paper, we present a model-based scheme for robust group activity characterization. The proposed approach takes advantage of synergy of multi-sensors data to track and identify key individual and group activity events based on fusion of imagery and acoustic sensors data. Each activity event is attributed by a set of tagged features. By matching and correlating attributes of events, the model attempts to associate sensory observations to a priori known ontology. The proposed model benefits from a fusion process that achieves perceptual grouping of activities by spatiotemporal correlation and association of fragmented perceptions extracted from attributed events. In this paper, we present the results of our experimental work and demonstrate the effective and robustness of the decision fusion technique in terms of properly classifying group activities and generating semantic messages describing dynamics of human group activities that, in turn, improves situational awareness.

AB - Proper characterization of human Group Activity (GA) interactions can help to detect and prevent certain pertinent threats efficiently. In this paper, we present a model-based scheme for robust group activity characterization. The proposed approach takes advantage of synergy of multi-sensors data to track and identify key individual and group activity events based on fusion of imagery and acoustic sensors data. Each activity event is attributed by a set of tagged features. By matching and correlating attributes of events, the model attempts to associate sensory observations to a priori known ontology. The proposed model benefits from a fusion process that achieves perceptual grouping of activities by spatiotemporal correlation and association of fragmented perceptions extracted from attributed events. In this paper, we present the results of our experimental work and demonstrate the effective and robustness of the decision fusion technique in terms of properly classifying group activities and generating semantic messages describing dynamics of human group activities that, in turn, improves situational awareness.

UR - http://www.scopus.com/inward/record.url?scp=84883402648&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84883402648&partnerID=8YFLogxK

U2 - 10.1109/ISI.2013.6578792

DO - 10.1109/ISI.2013.6578792

M3 - Conference contribution

AN - SCOPUS:84883402648

SN - 9781467362115

T3 - IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics

SP - 85

EP - 90

BT - IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics

ER -

Elangovan V, Alkilani A, Shirkhodaie A. A multi-modality attributes representation scheme for Group Activity characterization and data fusion. In IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics. 2013. p. 85-90. 6578792. (IEEE ISI 2013 - 2013 IEEE International Conference on Intelligence and Security Informatics: Big Data, Emergent Threats, and Decision-Making in Security Informatics). https://doi.org/10.1109/ISI.2013.6578792