The role of metacognition in robust AI systems

Matthew D. Schmill, Tim Oates, Michael L. Anderson, Darsana Josyula, Don Perlis, Shomir Wilson, Scott Fults

Research output: Contribution to conferencePaper

3 Scopus citations

Abstract

As automated systems become more complex, their propensity to fail in unexpected ways increases. As humans, we often notice their failures with the same ease that we recognize our own plans going awry. Yet the systems themselves are frequently oblivious that the function they are designed to perform is no longer being performed. This is because humans have explicit expectations - about both the system's behavior and our own behaviors - that allow us to notice an unexpected event. In this paper, we propose a way for AI systems to generate expectations about their own behavior, monitor them, and attempt to diagnose the underlying failures that cause them. Once a cause has been hypothesized, attempts at recovery can be made. The process is naturally meta-cognitive in that the system must reason about its own cognitive processes to arrive at an accurate and useful response. We present an architecture called the Meta-Cognitive Loop (MCL), which attempts to tackle robustness in cognitive systems in a domain general way, as a plug-in component to decrease the brittleness of AI systems.

Original languageEnglish (US)
Pages163-170
Number of pages8
Publication statusPublished - Dec 1 2008
Event2008 AAAI Workshop - Chicago, IL, United States
Duration: Jul 13 2008Jul 14 2008

Conference

Conference2008 AAAI Workshop
CountryUnited States
CityChicago, IL
Period7/13/087/14/08

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Cite this

Schmill, M. D., Oates, T., Anderson, M. L., Josyula, D., Perlis, D., Wilson, S., & Fults, S. (2008). The role of metacognition in robust AI systems. 163-170. Paper presented at 2008 AAAI Workshop, Chicago, IL, United States.