ContentEx: A framework for automatic content extraction programs

Linhai Song, Cheng Xueqi, Guo Yan, Liu Yue, Ding Guodong

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Web pages are often decorated with extraneous information (such as navigation bars, branding banners, JavaScript and advertisements). This kind of information may distract users from actual content they are really interested in and may reduce effects of many advanced web applications. Automatic content extraction has many applications ranging from providing data for web mining to realizing better accessing the web over mobile devices. In this paper, we propose ContentEx, a framework for automatic content extraction programs, which we use to organize codes of automatic content extraction programs and to facilitate the development of related solutions. We also introduce how we extract content from forum pages in this framework to fulfill the requirement from our actual application.

Original languageEnglish (US)
Title of host publication2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009
Pages188-190
Number of pages3
DOIs
StatePublished - Oct 22 2009
Event2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009 - Dallas, TX, United States
Duration: Jun 8 2009Jun 11 2009

Publication series

Name2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009

Other

Other2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009
CountryUnited States
CityDallas, TX
Period6/8/096/11/09

Fingerprint

Mobile devices
Websites
Navigation

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Information Systems
  • Software

Cite this

Song, L., Xueqi, C., Yan, G., Yue, L., & Guodong, D. (2009). ContentEx: A framework for automatic content extraction programs. In 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009 (pp. 188-190). [5137298] (2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009). https://doi.org/10.1109/ISI.2009.5137298
Song, Linhai ; Xueqi, Cheng ; Yan, Guo ; Yue, Liu ; Guodong, Ding. / ContentEx : A framework for automatic content extraction programs. 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009. 2009. pp. 188-190 (2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009).
@inproceedings{110a19e430544c0b87efda8369ed6e89,
title = "ContentEx: A framework for automatic content extraction programs",
abstract = "Web pages are often decorated with extraneous information (such as navigation bars, branding banners, JavaScript and advertisements). This kind of information may distract users from actual content they are really interested in and may reduce effects of many advanced web applications. Automatic content extraction has many applications ranging from providing data for web mining to realizing better accessing the web over mobile devices. In this paper, we propose ContentEx, a framework for automatic content extraction programs, which we use to organize codes of automatic content extraction programs and to facilitate the development of related solutions. We also introduce how we extract content from forum pages in this framework to fulfill the requirement from our actual application.",
author = "Linhai Song and Cheng Xueqi and Guo Yan and Liu Yue and Ding Guodong",
year = "2009",
month = "10",
day = "22",
doi = "10.1109/ISI.2009.5137298",
language = "English (US)",
isbn = "9781424441730",
series = "2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009",
pages = "188--190",
booktitle = "2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009",

}

Song, L, Xueqi, C, Yan, G, Yue, L & Guodong, D 2009, ContentEx: A framework for automatic content extraction programs. in 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009., 5137298, 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009, pp. 188-190, 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009, Dallas, TX, United States, 6/8/09. https://doi.org/10.1109/ISI.2009.5137298

ContentEx : A framework for automatic content extraction programs. / Song, Linhai; Xueqi, Cheng; Yan, Guo; Yue, Liu; Guodong, Ding.

2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009. 2009. p. 188-190 5137298 (2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - ContentEx

T2 - A framework for automatic content extraction programs

AU - Song, Linhai

AU - Xueqi, Cheng

AU - Yan, Guo

AU - Yue, Liu

AU - Guodong, Ding

PY - 2009/10/22

Y1 - 2009/10/22

N2 - Web pages are often decorated with extraneous information (such as navigation bars, branding banners, JavaScript and advertisements). This kind of information may distract users from actual content they are really interested in and may reduce effects of many advanced web applications. Automatic content extraction has many applications ranging from providing data for web mining to realizing better accessing the web over mobile devices. In this paper, we propose ContentEx, a framework for automatic content extraction programs, which we use to organize codes of automatic content extraction programs and to facilitate the development of related solutions. We also introduce how we extract content from forum pages in this framework to fulfill the requirement from our actual application.

AB - Web pages are often decorated with extraneous information (such as navigation bars, branding banners, JavaScript and advertisements). This kind of information may distract users from actual content they are really interested in and may reduce effects of many advanced web applications. Automatic content extraction has many applications ranging from providing data for web mining to realizing better accessing the web over mobile devices. In this paper, we propose ContentEx, a framework for automatic content extraction programs, which we use to organize codes of automatic content extraction programs and to facilitate the development of related solutions. We also introduce how we extract content from forum pages in this framework to fulfill the requirement from our actual application.

UR - http://www.scopus.com/inward/record.url?scp=70350052965&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350052965&partnerID=8YFLogxK

U2 - 10.1109/ISI.2009.5137298

DO - 10.1109/ISI.2009.5137298

M3 - Conference contribution

AN - SCOPUS:70350052965

SN - 9781424441730

T3 - 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009

SP - 188

EP - 190

BT - 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009

ER -

Song L, Xueqi C, Yan G, Yue L, Guodong D. ContentEx: A framework for automatic content extraction programs. In 2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009. 2009. p. 188-190. 5137298. (2009 IEEE International Conference on Intelligence and Security Informatics, ISI 2009). https://doi.org/10.1109/ISI.2009.5137298