Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems

Vinayak Elangovan, Amir Shirkhodaie

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

The improved Situational awareness in Persistent Surveillance Systems (PSS) is an ongoing research effort of the Department of Defense. Most PSS generate huge volume of raw data and they heavily rely on human operators to interpret and inference data in order to detect potential threats. Many outdoor apprehensive activities involve vehicles as their primary source of transportation to and from the scene where a plot is executed. Vehicles are employed to bring in and take out ammunitions, supplies, and personnel. Vehicles are also used as a disguise, hide-out, a meeting place to execute threat plots. Analysis of the Human-Vehicle Interactions (HVI) helps us to identify cohesive patterns of activities representing potential threats. Identification of such patterns can significantly improve situational awareness in PSS. In our approach, image processing technique is used as the primary source of sensing modality. We use HVI taxonomy as a means for recognizing different types of HVI activities. HVI taxonomy may comprise multiple threads of ontological patterns. By spatiotemporal linking of ontological patterns, a HVI pattern is hypothesized to pursue a potential threat situation. The proposed technique generates semantic messages describing ontology of HVI. This paper also discusses a vehicle zoning technique for HVI semantic labeling and demonstrates efficiency and effectiveness of the proposed technique for identifying HVI.

Original languageEnglish (US)
Title of host publicationVisual Information Processing XX
DOIs
StatePublished - Jul 21 2011
EventVisual Information Processing XX - Orlando, FL, United States
Duration: Apr 26 2011Apr 27 2011

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume8056
ISSN (Print)0277-786X

Other

OtherVisual Information Processing XX
CountryUnited States
CityOrlando, FL
Period4/26/114/27/11

Fingerprint

semantics
surveillance
Surveillance
Labeling
marking
vehicles
Semantics
Interaction
interactions
Situational Awareness
Taxonomy
taxonomy
situational awareness
Taxonomies
Human
Context
plots
ammunition
Ammunition
Thread

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Elangovan, V., & Shirkhodaie, A. (2011). Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems. In Visual Information Processing XX [80560I] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8056). https://doi.org/10.1117/12.883505
Elangovan, Vinayak ; Shirkhodaie, Amir. / Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems. Visual Information Processing XX. 2011. (Proceedings of SPIE - The International Society for Optical Engineering).
@inproceedings{c49f38d7430f46de8c6ef406bfd982b7,
title = "Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems",
abstract = "The improved Situational awareness in Persistent Surveillance Systems (PSS) is an ongoing research effort of the Department of Defense. Most PSS generate huge volume of raw data and they heavily rely on human operators to interpret and inference data in order to detect potential threats. Many outdoor apprehensive activities involve vehicles as their primary source of transportation to and from the scene where a plot is executed. Vehicles are employed to bring in and take out ammunitions, supplies, and personnel. Vehicles are also used as a disguise, hide-out, a meeting place to execute threat plots. Analysis of the Human-Vehicle Interactions (HVI) helps us to identify cohesive patterns of activities representing potential threats. Identification of such patterns can significantly improve situational awareness in PSS. In our approach, image processing technique is used as the primary source of sensing modality. We use HVI taxonomy as a means for recognizing different types of HVI activities. HVI taxonomy may comprise multiple threads of ontological patterns. By spatiotemporal linking of ontological patterns, a HVI pattern is hypothesized to pursue a potential threat situation. The proposed technique generates semantic messages describing ontology of HVI. This paper also discusses a vehicle zoning technique for HVI semantic labeling and demonstrates efficiency and effectiveness of the proposed technique for identifying HVI.",
author = "Vinayak Elangovan and Amir Shirkhodaie",
year = "2011",
month = "7",
day = "21",
doi = "10.1117/12.883505",
language = "English (US)",
isbn = "9780819486301",
series = "Proceedings of SPIE - The International Society for Optical Engineering",
booktitle = "Visual Information Processing XX",

}

Elangovan, V & Shirkhodaie, A 2011, Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems. in Visual Information Processing XX., 80560I, Proceedings of SPIE - The International Society for Optical Engineering, vol. 8056, Visual Information Processing XX, Orlando, FL, United States, 4/26/11. https://doi.org/10.1117/12.883505

Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems. / Elangovan, Vinayak; Shirkhodaie, Amir.

Visual Information Processing XX. 2011. 80560I (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 8056).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems

AU - Elangovan, Vinayak

AU - Shirkhodaie, Amir

PY - 2011/7/21

Y1 - 2011/7/21

N2 - The improved Situational awareness in Persistent Surveillance Systems (PSS) is an ongoing research effort of the Department of Defense. Most PSS generate huge volume of raw data and they heavily rely on human operators to interpret and inference data in order to detect potential threats. Many outdoor apprehensive activities involve vehicles as their primary source of transportation to and from the scene where a plot is executed. Vehicles are employed to bring in and take out ammunitions, supplies, and personnel. Vehicles are also used as a disguise, hide-out, a meeting place to execute threat plots. Analysis of the Human-Vehicle Interactions (HVI) helps us to identify cohesive patterns of activities representing potential threats. Identification of such patterns can significantly improve situational awareness in PSS. In our approach, image processing technique is used as the primary source of sensing modality. We use HVI taxonomy as a means for recognizing different types of HVI activities. HVI taxonomy may comprise multiple threads of ontological patterns. By spatiotemporal linking of ontological patterns, a HVI pattern is hypothesized to pursue a potential threat situation. The proposed technique generates semantic messages describing ontology of HVI. This paper also discusses a vehicle zoning technique for HVI semantic labeling and demonstrates efficiency and effectiveness of the proposed technique for identifying HVI.

AB - The improved Situational awareness in Persistent Surveillance Systems (PSS) is an ongoing research effort of the Department of Defense. Most PSS generate huge volume of raw data and they heavily rely on human operators to interpret and inference data in order to detect potential threats. Many outdoor apprehensive activities involve vehicles as their primary source of transportation to and from the scene where a plot is executed. Vehicles are employed to bring in and take out ammunitions, supplies, and personnel. Vehicles are also used as a disguise, hide-out, a meeting place to execute threat plots. Analysis of the Human-Vehicle Interactions (HVI) helps us to identify cohesive patterns of activities representing potential threats. Identification of such patterns can significantly improve situational awareness in PSS. In our approach, image processing technique is used as the primary source of sensing modality. We use HVI taxonomy as a means for recognizing different types of HVI activities. HVI taxonomy may comprise multiple threads of ontological patterns. By spatiotemporal linking of ontological patterns, a HVI pattern is hypothesized to pursue a potential threat situation. The proposed technique generates semantic messages describing ontology of HVI. This paper also discusses a vehicle zoning technique for HVI semantic labeling and demonstrates efficiency and effectiveness of the proposed technique for identifying HVI.

UR - http://www.scopus.com/inward/record.url?scp=79960418078&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960418078&partnerID=8YFLogxK

U2 - 10.1117/12.883505

DO - 10.1117/12.883505

M3 - Conference contribution

AN - SCOPUS:79960418078

SN - 9780819486301

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Visual Information Processing XX

ER -

Elangovan V, Shirkhodaie A. Context-based semantic labeling of Human-Vehicle Interactions in Persistent Surveillance Systems. In Visual Information Processing XX. 2011. 80560I. (Proceedings of SPIE - The International Society for Optical Engineering). https://doi.org/10.1117/12.883505