Visually-enabled active deep learning for (geo) text and image classification: A review

Liping Yang, Alan M. Maceachren, Prasenjit Mitra, Teresa Onorati

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

This paper investigates recent research on active learning for (geo) text and image classification, with an emphasis on methods that combine visual analytics and/or deep learning. Deep learning has attracted substantial attention across many domains of science and practice, because it can find intricate patterns in big data; but successful application of the methods requires a big set of labeled data. Active learning, which has the potential to address the data labeling challenge, has already had success in geospatial applications such as trajectory classification from movement data and (geo) text and image classification. This review is intended to be particularly relevant for extension of these methods to GISience, to support work in domains such as geographic information retrieval from text and image repositories, interpretation of spatial language, and related geo-semantics challenges. Specifically, to provide a structure for leveraging recent advances, we group the relevant work into five categories: Active learning, visual analytics, active learning with visual analytics, active deep learning, plus GIScience and Remote Sensing (RS) using active learning and active deep learning. Each category is exemplified by recent influential work. Based on this framing and our systematic review of key research, we then discuss some of the main challenges of integrating active learning with visual analytics and deep learning, and point out research opportunities from technical and application perspectives-for application-based opportunities, with emphasis on those that address big data with geospatial components.

Original languageEnglish (US)
Article number65
JournalISPRS International Journal of Geo-Information
Volume7
Issue number2
DOIs
StatePublished - Feb 2018

Fingerprint

Image classification
image classification
learning
Information retrieval
Labeling
Problem-Based Learning
Deep learning
Remote sensing
Semantics
Trajectories
information retrieval
repository
trajectory
semantics
remote sensing

All Science Journal Classification (ASJC) codes

  • Geography, Planning and Development
  • Computers in Earth Sciences
  • Earth and Planetary Sciences (miscellaneous)

Cite this

@article{7d395d873ed8476eae887e8fdf06231b,
title = "Visually-enabled active deep learning for (geo) text and image classification: A review",
abstract = "This paper investigates recent research on active learning for (geo) text and image classification, with an emphasis on methods that combine visual analytics and/or deep learning. Deep learning has attracted substantial attention across many domains of science and practice, because it can find intricate patterns in big data; but successful application of the methods requires a big set of labeled data. Active learning, which has the potential to address the data labeling challenge, has already had success in geospatial applications such as trajectory classification from movement data and (geo) text and image classification. This review is intended to be particularly relevant for extension of these methods to GISience, to support work in domains such as geographic information retrieval from text and image repositories, interpretation of spatial language, and related geo-semantics challenges. Specifically, to provide a structure for leveraging recent advances, we group the relevant work into five categories: Active learning, visual analytics, active learning with visual analytics, active deep learning, plus GIScience and Remote Sensing (RS) using active learning and active deep learning. Each category is exemplified by recent influential work. Based on this framing and our systematic review of key research, we then discuss some of the main challenges of integrating active learning with visual analytics and deep learning, and point out research opportunities from technical and application perspectives-for application-based opportunities, with emphasis on those that address big data with geospatial components.",
author = "Liping Yang and Maceachren, {Alan M.} and Prasenjit Mitra and Teresa Onorati",
year = "2018",
month = "2",
doi = "10.3390/ijgi7020065",
language = "English (US)",
volume = "7",
journal = "ISPRS International Journal of Geo-Information",
issn = "2220-9964",
publisher = "MDPI AG",
number = "2",

}

Visually-enabled active deep learning for (geo) text and image classification : A review. / Yang, Liping; Maceachren, Alan M.; Mitra, Prasenjit; Onorati, Teresa.

In: ISPRS International Journal of Geo-Information, Vol. 7, No. 2, 65, 02.2018.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Visually-enabled active deep learning for (geo) text and image classification

T2 - A review

AU - Yang, Liping

AU - Maceachren, Alan M.

AU - Mitra, Prasenjit

AU - Onorati, Teresa

PY - 2018/2

Y1 - 2018/2

N2 - This paper investigates recent research on active learning for (geo) text and image classification, with an emphasis on methods that combine visual analytics and/or deep learning. Deep learning has attracted substantial attention across many domains of science and practice, because it can find intricate patterns in big data; but successful application of the methods requires a big set of labeled data. Active learning, which has the potential to address the data labeling challenge, has already had success in geospatial applications such as trajectory classification from movement data and (geo) text and image classification. This review is intended to be particularly relevant for extension of these methods to GISience, to support work in domains such as geographic information retrieval from text and image repositories, interpretation of spatial language, and related geo-semantics challenges. Specifically, to provide a structure for leveraging recent advances, we group the relevant work into five categories: Active learning, visual analytics, active learning with visual analytics, active deep learning, plus GIScience and Remote Sensing (RS) using active learning and active deep learning. Each category is exemplified by recent influential work. Based on this framing and our systematic review of key research, we then discuss some of the main challenges of integrating active learning with visual analytics and deep learning, and point out research opportunities from technical and application perspectives-for application-based opportunities, with emphasis on those that address big data with geospatial components.

AB - This paper investigates recent research on active learning for (geo) text and image classification, with an emphasis on methods that combine visual analytics and/or deep learning. Deep learning has attracted substantial attention across many domains of science and practice, because it can find intricate patterns in big data; but successful application of the methods requires a big set of labeled data. Active learning, which has the potential to address the data labeling challenge, has already had success in geospatial applications such as trajectory classification from movement data and (geo) text and image classification. This review is intended to be particularly relevant for extension of these methods to GISience, to support work in domains such as geographic information retrieval from text and image repositories, interpretation of spatial language, and related geo-semantics challenges. Specifically, to provide a structure for leveraging recent advances, we group the relevant work into five categories: Active learning, visual analytics, active learning with visual analytics, active deep learning, plus GIScience and Remote Sensing (RS) using active learning and active deep learning. Each category is exemplified by recent influential work. Based on this framing and our systematic review of key research, we then discuss some of the main challenges of integrating active learning with visual analytics and deep learning, and point out research opportunities from technical and application perspectives-for application-based opportunities, with emphasis on those that address big data with geospatial components.

UR - http://www.scopus.com/inward/record.url?scp=85043275308&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85043275308&partnerID=8YFLogxK

U2 - 10.3390/ijgi7020065

DO - 10.3390/ijgi7020065

M3 - Article

AN - SCOPUS:85043275308

VL - 7

JO - ISPRS International Journal of Geo-Information

JF - ISPRS International Journal of Geo-Information

SN - 2220-9964

IS - 2

M1 - 65

ER -