Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors

Hasan Ayaz, Ben Willems, Scott Bunce, Patricia A. Shewokis, Kurtulus Izzetoglu, Sehchang Hah, Atul Deshmukh, Banu Onaral

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)

Abstract

Deployment of portable neuroimaging technologies to operating settings could help assess cognitive states of personnel assigned to perform critical tasks and thus help improve efficiency and safety of human machine systems. Functional Near Infrared Spectroscopy (fNIR) is an emerging noninvasive brain imaging technology that relies on optical techniques to detect brain hemodynamics within the prefrontal cortex in response to sensory, motor, or cognitive activation. Collaborating with the FAA William J. Hughes Technical Center, fNIR has been used to monitor twenty four certified professional controllers as they manage realistic Air Traffic Control (ATC) scenarios under typical and emergent conditions. We have implemented a normalization procedure to estimate cognitive workload levels from fNIR signals during ATC by developing linear regression models that were informed by the respective participants' prior n-back data. This normalization can account for oxygenation variance due to inter-personal physiological differences. Results indicate that fNIR is sensitive task loads during ATC.

Original languageEnglish (US)
Title of host publicationFoundations of Augmented Cognition
Subtitle of host publicationDirecting the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings
Pages549-558
Number of pages10
DOIs
StatePublished - Jul 19 2011
Event6th International Conference on Foundations of Augmented Cognition, FAC 2011, Held as Part of HCI International 2011 - Orlando, FL, United States
Duration: Jul 9 2011Jul 14 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6780 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other6th International Conference on Foundations of Augmented Cognition, FAC 2011, Held as Part of HCI International 2011
CountryUnited States
CityOrlando, FL
Period7/9/117/14/11

Fingerprint

Air Traffic Control
Near-infrared Spectroscopy
Air traffic control
Near infrared spectroscopy
Workload
Brain
Imaging
Imaging techniques
Sensor
Sensors
Normalization
Neuroimaging
Man machine systems
Oxygenation
Hemodynamics
Cortex
Linear Regression Model
Linear regression
Activation
Monitor

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ayaz, H., Willems, B., Bunce, S., Shewokis, P. A., Izzetoglu, K., Hah, S., ... Onaral, B. (2011). Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In Foundations of Augmented Cognition: Directing the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings (pp. 549-558). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6780 LNAI). https://doi.org/10.1007/978-3-642-21852-1_63
Ayaz, Hasan ; Willems, Ben ; Bunce, Scott ; Shewokis, Patricia A. ; Izzetoglu, Kurtulus ; Hah, Sehchang ; Deshmukh, Atul ; Onaral, Banu. / Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. Foundations of Augmented Cognition: Directing the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings. 2011. pp. 549-558 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{52ec4f3742244fb49439a98f3b801f49,
title = "Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors",
abstract = "Deployment of portable neuroimaging technologies to operating settings could help assess cognitive states of personnel assigned to perform critical tasks and thus help improve efficiency and safety of human machine systems. Functional Near Infrared Spectroscopy (fNIR) is an emerging noninvasive brain imaging technology that relies on optical techniques to detect brain hemodynamics within the prefrontal cortex in response to sensory, motor, or cognitive activation. Collaborating with the FAA William J. Hughes Technical Center, fNIR has been used to monitor twenty four certified professional controllers as they manage realistic Air Traffic Control (ATC) scenarios under typical and emergent conditions. We have implemented a normalization procedure to estimate cognitive workload levels from fNIR signals during ATC by developing linear regression models that were informed by the respective participants' prior n-back data. This normalization can account for oxygenation variance due to inter-personal physiological differences. Results indicate that fNIR is sensitive task loads during ATC.",
author = "Hasan Ayaz and Ben Willems and Scott Bunce and Shewokis, {Patricia A.} and Kurtulus Izzetoglu and Sehchang Hah and Atul Deshmukh and Banu Onaral",
year = "2011",
month = "7",
day = "19",
doi = "10.1007/978-3-642-21852-1_63",
language = "English (US)",
isbn = "9783642218514",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "549--558",
booktitle = "Foundations of Augmented Cognition",

}

Ayaz, H, Willems, B, Bunce, S, Shewokis, PA, Izzetoglu, K, Hah, S, Deshmukh, A & Onaral, B 2011, Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. in Foundations of Augmented Cognition: Directing the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6780 LNAI, pp. 549-558, 6th International Conference on Foundations of Augmented Cognition, FAC 2011, Held as Part of HCI International 2011, Orlando, FL, United States, 7/9/11. https://doi.org/10.1007/978-3-642-21852-1_63

Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. / Ayaz, Hasan; Willems, Ben; Bunce, Scott; Shewokis, Patricia A.; Izzetoglu, Kurtulus; Hah, Sehchang; Deshmukh, Atul; Onaral, Banu.

Foundations of Augmented Cognition: Directing the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings. 2011. p. 549-558 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6780 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors

AU - Ayaz, Hasan

AU - Willems, Ben

AU - Bunce, Scott

AU - Shewokis, Patricia A.

AU - Izzetoglu, Kurtulus

AU - Hah, Sehchang

AU - Deshmukh, Atul

AU - Onaral, Banu

PY - 2011/7/19

Y1 - 2011/7/19

N2 - Deployment of portable neuroimaging technologies to operating settings could help assess cognitive states of personnel assigned to perform critical tasks and thus help improve efficiency and safety of human machine systems. Functional Near Infrared Spectroscopy (fNIR) is an emerging noninvasive brain imaging technology that relies on optical techniques to detect brain hemodynamics within the prefrontal cortex in response to sensory, motor, or cognitive activation. Collaborating with the FAA William J. Hughes Technical Center, fNIR has been used to monitor twenty four certified professional controllers as they manage realistic Air Traffic Control (ATC) scenarios under typical and emergent conditions. We have implemented a normalization procedure to estimate cognitive workload levels from fNIR signals during ATC by developing linear regression models that were informed by the respective participants' prior n-back data. This normalization can account for oxygenation variance due to inter-personal physiological differences. Results indicate that fNIR is sensitive task loads during ATC.

AB - Deployment of portable neuroimaging technologies to operating settings could help assess cognitive states of personnel assigned to perform critical tasks and thus help improve efficiency and safety of human machine systems. Functional Near Infrared Spectroscopy (fNIR) is an emerging noninvasive brain imaging technology that relies on optical techniques to detect brain hemodynamics within the prefrontal cortex in response to sensory, motor, or cognitive activation. Collaborating with the FAA William J. Hughes Technical Center, fNIR has been used to monitor twenty four certified professional controllers as they manage realistic Air Traffic Control (ATC) scenarios under typical and emergent conditions. We have implemented a normalization procedure to estimate cognitive workload levels from fNIR signals during ATC by developing linear regression models that were informed by the respective participants' prior n-back data. This normalization can account for oxygenation variance due to inter-personal physiological differences. Results indicate that fNIR is sensitive task loads during ATC.

UR - http://www.scopus.com/inward/record.url?scp=79960311694&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79960311694&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-21852-1_63

DO - 10.1007/978-3-642-21852-1_63

M3 - Conference contribution

AN - SCOPUS:79960311694

SN - 9783642218514

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 549

EP - 558

BT - Foundations of Augmented Cognition

ER -

Ayaz H, Willems B, Bunce S, Shewokis PA, Izzetoglu K, Hah S et al. Estimation of cognitive workload during simulated air traffic control using optical brain imaging sensors. In Foundations of Augmented Cognition: Directing the Future of Adaptive Systems - 6th International Conference, FAC 2011, Held as Part of HCI International 2011, Proceedings. 2011. p. 549-558. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-21852-1_63