Toward robust classification using the Open Directory Project

Jongwoo Ha; Jung Hyun Lee; Won Jun Jang; Yong Ku Lee; Sang-Geun Lee

doi:10.1109/DSAA.2014.7058134

Toward robust classification using the Open Directory Project

Jongwoo Ha, Jung Hyun Lee, Won Jun Jang, Yong Ku Lee, Sang-Geun Lee

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Citations (Scopus)

Abstract

The Open Directory Project (ODP) is a large scale, high quality and publicly available web directory utilized in many studies and real-world applications. In this paper, we explore training data expansion techniques for text classification as one of the possible directions to deal with the sparse characteristic of the ODP dataset. We propose a dozen classification methods, which can be differentiated by (1) from which categories training data is expanded, and (2) how the expanded training data is merged to generate centroid vectors. Evaluation results show that training data expansion significantly improves the classification performance more than representative classifiers. We also find that (1) child and descendant categories are more valuable sources to expand training data than parent and ancestor categories, and (2) distance-based weighting is superior to simple averaging to merge the expanded training data.

Original language	English
Title of host publication	DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics
Editors	George Karypis, Longbing Cao, Wei Wang, Irwin King
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	607-612
Number of pages	6
ISBN (Electronic)	9781479969913
DOIs	https://doi.org/10.1109/DSAA.2014.7058134
Publication status	Published - 2014 Mar 10
Event	2014 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2014 - Shanghai, China Duration: 2014 Oct 30 → 2014 Nov 1

Publication series

Name	DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics

Other

Other	2014 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2014
Country/Territory	China
City	Shanghai
Period	14/10/30 → 14/11/1

Bibliographical note

Publisher Copyright:
© 2014 IEEE.

ASJC Scopus subject areas

Artificial Intelligence
Information Systems
Information Systems and Management

Access to Document

10.1109/DSAA.2014.7058134

Cite this

Ha, J., Lee, J. H., Jang, W. J., Lee, Y. K., & Lee, S.-G. (2014). Toward robust classification using the Open Directory Project. In G. Karypis, L. Cao, W. Wang, & I. King (Eds.), DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics (pp. 607-612). Article 7058134 (DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DSAA.2014.7058134

Toward robust classification using the Open Directory Project. / Ha, Jongwoo; Lee, Jung Hyun; Jang, Won Jun et al.
DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics. ed. / George Karypis; Longbing Cao; Wei Wang; Irwin King. Institute of Electrical and Electronics Engineers Inc., 2014. p. 607-612 7058134 (DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Ha, J, Lee, JH, Jang, WJ, Lee, YK & Lee, S-G 2014, Toward robust classification using the Open Directory Project. in G Karypis, L Cao, W Wang & I King (eds), DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics., 7058134, DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics, Institute of Electrical and Electronics Engineers Inc., pp. 607-612, 2014 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2014, Shanghai, China, 14/10/30. https://doi.org/10.1109/DSAA.2014.7058134

Ha J, Lee JH, Jang WJ, Lee YK, Lee SG. Toward robust classification using the Open Directory Project. In Karypis G, Cao L, Wang W, King I, editors, DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics. Institute of Electrical and Electronics Engineers Inc. 2014. p. 607-612. 7058134. (DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics). doi: 10.1109/DSAA.2014.7058134

Ha, Jongwoo ; Lee, Jung Hyun ; Jang, Won Jun et al. / Toward robust classification using the Open Directory Project. DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics. editor / George Karypis ; Longbing Cao ; Wei Wang ; Irwin King. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 607-612 (DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics).

@inproceedings{cfe1f5b3477141f2942e37cc8817ec92,

title = "Toward robust classification using the Open Directory Project",

abstract = "The Open Directory Project (ODP) is a large scale, high quality and publicly available web directory utilized in many studies and real-world applications. In this paper, we explore training data expansion techniques for text classification as one of the possible directions to deal with the sparse characteristic of the ODP dataset. We propose a dozen classification methods, which can be differentiated by (1) from which categories training data is expanded, and (2) how the expanded training data is merged to generate centroid vectors. Evaluation results show that training data expansion significantly improves the classification performance more than representative classifiers. We also find that (1) child and descendant categories are more valuable sources to expand training data than parent and ancestor categories, and (2) distance-based weighting is superior to simple averaging to merge the expanded training data.",

author = "Jongwoo Ha and Lee, {Jung Hyun} and Jang, {Won Jun} and Lee, {Yong Ku} and Sang-Geun Lee",

note = "Publisher Copyright: {\textcopyright} 2014 IEEE.; 2014 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2014 ; Conference date: 30-10-2014 Through 01-11-2014",

year = "2014",

month = mar,

day = "10",

doi = "10.1109/DSAA.2014.7058134",

language = "English",

series = "DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "607--612",

editor = "George Karypis and Longbing Cao and Wei Wang and Irwin King",

booktitle = "DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics",

}

TY - GEN

T1 - Toward robust classification using the Open Directory Project

AU - Ha, Jongwoo

AU - Lee, Jung Hyun

AU - Jang, Won Jun

AU - Lee, Yong Ku

AU - Lee, Sang-Geun

PY - 2014/3/10

Y1 - 2014/3/10

N2 - The Open Directory Project (ODP) is a large scale, high quality and publicly available web directory utilized in many studies and real-world applications. In this paper, we explore training data expansion techniques for text classification as one of the possible directions to deal with the sparse characteristic of the ODP dataset. We propose a dozen classification methods, which can be differentiated by (1) from which categories training data is expanded, and (2) how the expanded training data is merged to generate centroid vectors. Evaluation results show that training data expansion significantly improves the classification performance more than representative classifiers. We also find that (1) child and descendant categories are more valuable sources to expand training data than parent and ancestor categories, and (2) distance-based weighting is superior to simple averaging to merge the expanded training data.

AB - The Open Directory Project (ODP) is a large scale, high quality and publicly available web directory utilized in many studies and real-world applications. In this paper, we explore training data expansion techniques for text classification as one of the possible directions to deal with the sparse characteristic of the ODP dataset. We propose a dozen classification methods, which can be differentiated by (1) from which categories training data is expanded, and (2) how the expanded training data is merged to generate centroid vectors. Evaluation results show that training data expansion significantly improves the classification performance more than representative classifiers. We also find that (1) child and descendant categories are more valuable sources to expand training data than parent and ancestor categories, and (2) distance-based weighting is superior to simple averaging to merge the expanded training data.

UR - http://www.scopus.com/inward/record.url?scp=84937766992&partnerID=8YFLogxK

U2 - 10.1109/DSAA.2014.7058134

DO - 10.1109/DSAA.2014.7058134

M3 - Conference contribution

AN - SCOPUS:84937766992

T3 - DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics

SP - 607

EP - 612

BT - DSAA 2014 - Proceedings of the 2014 IEEE International Conference on Data Science and Advanced Analytics

A2 - Karypis, George

A2 - Cao, Longbing

A2 - Wang, Wei

A2 - King, Irwin

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2014

Y2 - 30 October 2014 through 1 November 2014

ER -

Toward robust classification using the Open Directory Project

Abstract

Publication series

Other

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this