Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources

Doina Caragea, Jun Zhang, Jie Bao, Jyotishman Pathak, Vasant Honavar

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Citations (Scopus)

Abstract

Development of high throughput data acquisition technologies, together with advances in computing, and communications have resulted in an explosive growth in the number, size, and diversity of potentially useful information sources. This has resulted in unprecedented opportunities in data-driven knowledge acquisition and decision-making in a number of emerging increasingly data-rich application domains such as bioinformatics, environmental informatics, enterprise informatics, and social informatics (among others). However, the massive size, semantic heterogeneity, autonomy, and distributed nature of the data repositories present significant hurdles in acquiring useful knowledge from the available data. This paper introduces some of the algorithmic and statistical problems that arise in such a setting, describes algorithms for learning classifiers from distributed data that offer rigorous performance guarantees (relative to their centralized or batch counterparts). It also describes how this approach can be extended to work with autonomous, and hence, inevitably semantically heterogeneous data sources, by making explicit, the ontologies (attributes and relationships between attributes) associated with the data sources and reconciling the semantic differences among the data sources from a user's point of view. This allows user or context-dependent exploration of semantically heterogeneous data sources. The resulting algorithms have been implemented in INDUS - an open source software package for collaborative discovery from autonomous, semantically heterogeneous, distributed data sources.

Original languageEnglish (US)
Title of host publicationAlgorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings
Pages13-44
Number of pages32
DOIs
StatePublished - Dec 1 2005
Event16th International Conference on Algorithmic Learning Theory, ALT 2005 - Singapore, Singapore
Duration: Oct 8 2005Oct 11 2005

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3734 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other16th International Conference on Algorithmic Learning Theory, ALT 2005
CountrySingapore
CitySingapore
Period10/8/0510/11/05

Fingerprint

Semantics
Software
Knowledge acquisition
Bioinformatics
Software packages
Ontology
Data acquisition
Classifiers
Decision making
Throughput
Communication
Industry
Attribute
Performance Guarantee
Open Source Software
Knowledge Acquisition
Data Acquisition
Data-driven
Software Package
Repository

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Caragea, D., Zhang, J., Bao, J., Pathak, J., & Honavar, V. (2005). Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources. In Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings (pp. 13-44). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3734 LNAI). https://doi.org/10.1007/11564089_5
Caragea, Doina ; Zhang, Jun ; Bao, Jie ; Pathak, Jyotishman ; Honavar, Vasant. / Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources. Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings. 2005. pp. 13-44 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{668b8e6df38842bbb801ca7bded23453,
title = "Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources",
abstract = "Development of high throughput data acquisition technologies, together with advances in computing, and communications have resulted in an explosive growth in the number, size, and diversity of potentially useful information sources. This has resulted in unprecedented opportunities in data-driven knowledge acquisition and decision-making in a number of emerging increasingly data-rich application domains such as bioinformatics, environmental informatics, enterprise informatics, and social informatics (among others). However, the massive size, semantic heterogeneity, autonomy, and distributed nature of the data repositories present significant hurdles in acquiring useful knowledge from the available data. This paper introduces some of the algorithmic and statistical problems that arise in such a setting, describes algorithms for learning classifiers from distributed data that offer rigorous performance guarantees (relative to their centralized or batch counterparts). It also describes how this approach can be extended to work with autonomous, and hence, inevitably semantically heterogeneous data sources, by making explicit, the ontologies (attributes and relationships between attributes) associated with the data sources and reconciling the semantic differences among the data sources from a user's point of view. This allows user or context-dependent exploration of semantically heterogeneous data sources. The resulting algorithms have been implemented in INDUS - an open source software package for collaborative discovery from autonomous, semantically heterogeneous, distributed data sources.",
author = "Doina Caragea and Jun Zhang and Jie Bao and Jyotishman Pathak and Vasant Honavar",
year = "2005",
month = "12",
day = "1",
doi = "10.1007/11564089_5",
language = "English (US)",
isbn = "354029242X",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "13--44",
booktitle = "Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings",

}

Caragea, D, Zhang, J, Bao, J, Pathak, J & Honavar, V 2005, Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources. in Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3734 LNAI, pp. 13-44, 16th International Conference on Algorithmic Learning Theory, ALT 2005, Singapore, Singapore, 10/8/05. https://doi.org/10.1007/11564089_5

Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources. / Caragea, Doina; Zhang, Jun; Bao, Jie; Pathak, Jyotishman; Honavar, Vasant.

Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings. 2005. p. 13-44 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3734 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources

AU - Caragea, Doina

AU - Zhang, Jun

AU - Bao, Jie

AU - Pathak, Jyotishman

AU - Honavar, Vasant

PY - 2005/12/1

Y1 - 2005/12/1

N2 - Development of high throughput data acquisition technologies, together with advances in computing, and communications have resulted in an explosive growth in the number, size, and diversity of potentially useful information sources. This has resulted in unprecedented opportunities in data-driven knowledge acquisition and decision-making in a number of emerging increasingly data-rich application domains such as bioinformatics, environmental informatics, enterprise informatics, and social informatics (among others). However, the massive size, semantic heterogeneity, autonomy, and distributed nature of the data repositories present significant hurdles in acquiring useful knowledge from the available data. This paper introduces some of the algorithmic and statistical problems that arise in such a setting, describes algorithms for learning classifiers from distributed data that offer rigorous performance guarantees (relative to their centralized or batch counterparts). It also describes how this approach can be extended to work with autonomous, and hence, inevitably semantically heterogeneous data sources, by making explicit, the ontologies (attributes and relationships between attributes) associated with the data sources and reconciling the semantic differences among the data sources from a user's point of view. This allows user or context-dependent exploration of semantically heterogeneous data sources. The resulting algorithms have been implemented in INDUS - an open source software package for collaborative discovery from autonomous, semantically heterogeneous, distributed data sources.

AB - Development of high throughput data acquisition technologies, together with advances in computing, and communications have resulted in an explosive growth in the number, size, and diversity of potentially useful information sources. This has resulted in unprecedented opportunities in data-driven knowledge acquisition and decision-making in a number of emerging increasingly data-rich application domains such as bioinformatics, environmental informatics, enterprise informatics, and social informatics (among others). However, the massive size, semantic heterogeneity, autonomy, and distributed nature of the data repositories present significant hurdles in acquiring useful knowledge from the available data. This paper introduces some of the algorithmic and statistical problems that arise in such a setting, describes algorithms for learning classifiers from distributed data that offer rigorous performance guarantees (relative to their centralized or batch counterparts). It also describes how this approach can be extended to work with autonomous, and hence, inevitably semantically heterogeneous data sources, by making explicit, the ontologies (attributes and relationships between attributes) associated with the data sources and reconciling the semantic differences among the data sources from a user's point of view. This allows user or context-dependent exploration of semantically heterogeneous data sources. The resulting algorithms have been implemented in INDUS - an open source software package for collaborative discovery from autonomous, semantically heterogeneous, distributed data sources.

UR - http://www.scopus.com/inward/record.url?scp=33646515517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33646515517&partnerID=8YFLogxK

U2 - 10.1007/11564089_5

DO - 10.1007/11564089_5

M3 - Conference contribution

AN - SCOPUS:33646515517

SN - 354029242X

SN - 9783540292425

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 13

EP - 44

BT - Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings

ER -

Caragea D, Zhang J, Bao J, Pathak J, Honavar V. Algorithms and software for collaborative discovery from autonomous, semantically heterogeneous, distributed information sources. In Algorithmic Learning Theory - 16th International Conference, ALT 2005, Proceedings. 2005. p. 13-44. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/11564089_5