PDFMEF: A multi-entity knowledge extraction framework for scholarly documents and semantic search

Jian Wu, Jason Killian, Huaiyu Yang, Kyle Williams, Sagnik Ray Choudhury, Suppawong Tuarob, Cornelia Caragea, C. Lee Giles

Research output: Chapter in Book/Report/Conference proceedingConference contribution

19 Scopus citations

Abstract

We introduce PDFMEF, a multi-entity knowledge extrac- tion framework for scholarly documents in the PDF format. It is implemented with a framework that encapsulates open- source extraction tools. Currently, it leverages PDFBox and TET for full text extraction, the scholarly document filter described in [5] for document classification, GROBID for header extraction, ParsCit for citation extraction, PDFFig- ures for figure and table extraction, and algorithm extrac- tion [27]. While it can be run as a whole, the extraction tool in each module is highly customizable. Users can sub- stitute default extractors with other extraction tools they prefer by writing a thin wrapper to implement the abstracts. The framework is designed to be scalable and is capable of running in parallel using a multi-processing technique in Python. Experiments indicate that the system with default setups is CPU bounded, and leaves a small footprint in the memory, which makes it best to run on a multi-core machine. The best performance using a dedicated server of 16 cores takes 1.3 seconds on average to process one PDF document. It is used to index extracted information and help users to quickly locate relevant results in published scholarly docu- ments and to eficiently construct a large knowledge base in order to build a semantic scholarly search engine. Part of it is running on CiteSeerX digital library search engine.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th International Conference on Knowledge Capture, K-CAP 2015
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450338493
DOIs
StatePublished - Oct 7 2015
Event8th International Conference on Knowledge Capture, K-CAP 2015 - Palisades, United States
Duration: Oct 7 2015Oct 10 2015

Publication series

NameProceedings of the 8th International Conference on Knowledge Capture, K-CAP 2015

Other

Other8th International Conference on Knowledge Capture, K-CAP 2015
CountryUnited States
CityPalisades
Period10/7/1510/10/15

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Information Systems
  • Software

Fingerprint Dive into the research topics of 'PDFMEF: A multi-entity knowledge extraction framework for scholarly documents and semantic search'. Together they form a unique fingerprint.

Cite this