Abstract
Ground-truth datasets are essential for the training and evaluation of any automated algorithm. As such, gold-standard annotated corpora underlie most advances in natural language processing (NLP). However, only a few relatively small (geo-)annotated datasets are available for geoparsing, i.e., the automatic recognition and geolocation of place references in unstructured text. The creation of geoparsing corpora that include both the recognition of place names in text and matching of those names to toponyms in a geographic gazetteer (a process we call geo-annotation), is a laborious, time-consuming and expensive task. The field lacks efficient geo-annotation tools to support corpus building and lacks design guidelines for the development of such tools. Here, we present the iterative design of GeoAnnotator, a web-based, semi-automatic and collaborative visual analytics platform for geo-annotation. GeoAnnotator facilitates collaborative, multi-annotator creation of large corpora of geo-annotated text by generating computationally-generated pre-annotations that can be improved by human-annotator users. The resulting corpora can be used in improving and benchmarking geoparsing algorithms as well as various other spatial language-related methods. Further, the iterative design process and the resulting design decisions can be used in annotation platforms tailored for other application domains of NLP.
| Original language | English (US) |
|---|---|
| Article number | 161 |
| Journal | ISPRS International Journal of Geo-Information |
| Volume | 8 |
| Issue number | 4 |
| DOIs | |
| State | Published - Mar 27 2019 |
Fingerprint
All Science Journal Classification (ASJC) codes
- Geography, Planning and Development
- Computers in Earth Sciences
- Earth and Planetary Sciences (miscellaneous)
Cite this
}
Geoannotator : A collaborative semi-automatic platform for constructing geo-annotated text corpora. / Karimzadeh, Morteza; MacEachren, Alan M.
In: ISPRS International Journal of Geo-Information, Vol. 8, No. 4, 161, 27.03.2019.Research output: Contribution to journal › Article
TY - JOUR
T1 - Geoannotator
T2 - A collaborative semi-automatic platform for constructing geo-annotated text corpora
AU - Karimzadeh, Morteza
AU - MacEachren, Alan M.
PY - 2019/3/27
Y1 - 2019/3/27
N2 - Ground-truth datasets are essential for the training and evaluation of any automated algorithm. As such, gold-standard annotated corpora underlie most advances in natural language processing (NLP). However, only a few relatively small (geo-)annotated datasets are available for geoparsing, i.e., the automatic recognition and geolocation of place references in unstructured text. The creation of geoparsing corpora that include both the recognition of place names in text and matching of those names to toponyms in a geographic gazetteer (a process we call geo-annotation), is a laborious, time-consuming and expensive task. The field lacks efficient geo-annotation tools to support corpus building and lacks design guidelines for the development of such tools. Here, we present the iterative design of GeoAnnotator, a web-based, semi-automatic and collaborative visual analytics platform for geo-annotation. GeoAnnotator facilitates collaborative, multi-annotator creation of large corpora of geo-annotated text by generating computationally-generated pre-annotations that can be improved by human-annotator users. The resulting corpora can be used in improving and benchmarking geoparsing algorithms as well as various other spatial language-related methods. Further, the iterative design process and the resulting design decisions can be used in annotation platforms tailored for other application domains of NLP.
AB - Ground-truth datasets are essential for the training and evaluation of any automated algorithm. As such, gold-standard annotated corpora underlie most advances in natural language processing (NLP). However, only a few relatively small (geo-)annotated datasets are available for geoparsing, i.e., the automatic recognition and geolocation of place references in unstructured text. The creation of geoparsing corpora that include both the recognition of place names in text and matching of those names to toponyms in a geographic gazetteer (a process we call geo-annotation), is a laborious, time-consuming and expensive task. The field lacks efficient geo-annotation tools to support corpus building and lacks design guidelines for the development of such tools. Here, we present the iterative design of GeoAnnotator, a web-based, semi-automatic and collaborative visual analytics platform for geo-annotation. GeoAnnotator facilitates collaborative, multi-annotator creation of large corpora of geo-annotated text by generating computationally-generated pre-annotations that can be improved by human-annotator users. The resulting corpora can be used in improving and benchmarking geoparsing algorithms as well as various other spatial language-related methods. Further, the iterative design process and the resulting design decisions can be used in annotation platforms tailored for other application domains of NLP.
UR - http://www.scopus.com/inward/record.url?scp=85066443192&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85066443192&partnerID=8YFLogxK
U2 - 10.3390/ijgi8040161
DO - 10.3390/ijgi8040161
M3 - Article
AN - SCOPUS:85066443192
VL - 8
JO - ISPRS International Journal of Geo-Information
JF - ISPRS International Journal of Geo-Information
SN - 2220-9964
IS - 4
M1 - 161
ER -