Decision tree decomposition-based complex feature selection for text chunking

Young Sook Hwang; Hae Chang Rim

doi:10.1109/ICONIP.2002.1201887

Decision tree decomposition-based complex feature selection for text chunking

Young Sook Hwang, Hae Chang Rim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

Incorporating a method of feature selection into a classification model often provides a number of advantages. In this paper we propose a new feature selection method based on the discriminative perspective of improving the classification accuracy. The feature selection method is developed for a classification model for text chunking. For effective feature selection, we utilize a decision tree as an intermediate feature space inducer. To select a more compact feature set with less computational load, we organized a partially ordered feature space according to the IGR distribution of features. Experimental results show that: (1) the computational complexity on high-dimensional feature space can be reduced by selecting features based on the decision tree decomposition; (2) the text chunking system using the proposed feature selection can significantly improve the performance compared with a decision tree classifier.

Original language	English
Title of host publication	ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing
Subtitle of host publication	Computational Intelligence for the E-Age
Editors	Xin Yao, Kunihiko Fukushima, Soo-Young Lee, Lipo Wang, Jagath C. Rajapakse
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	2217-2222
Number of pages	6
ISBN (Electronic)	9810475241, 9789810475246
DOIs	https://doi.org/10.1109/ICONIP.2002.1201887
Publication status	Published - 2002
Event	9th International Conference on Neural Information Processing, ICONIP 2002 - Singapore, Singapore Duration: 2002 Nov 18 → 2002 Nov 22

Publication series

Name	ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age
Volume	5

Other

Other	9th International Conference on Neural Information Processing, ICONIP 2002
Country/Territory	Singapore
City	Singapore
Period	02/11/18 → 02/11/22

Bibliographical note

Publisher Copyright:
© 2002 Nanyang Technological University.

ASJC Scopus subject areas

Computer Networks and Communications
Information Systems
Signal Processing

Access to Document

10.1109/ICONIP.2002.1201887

Cite this

Hwang, Y. S., & Rim, H. C. (2002). Decision tree decomposition-based complex feature selection for text chunking. In X. Yao, K. Fukushima, S.-Y. Lee, L. Wang, & J. C. Rajapakse (Eds.), ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age (pp. 2217-2222). Article 1201887 (ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age; Vol. 5). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICONIP.2002.1201887

Decision tree decomposition-based complex feature selection for text chunking. / Hwang, Young Sook; Rim, Hae Chang.
ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age. ed. / Xin Yao; Kunihiko Fukushima; Soo-Young Lee; Lipo Wang; Jagath C. Rajapakse. Institute of Electrical and Electronics Engineers Inc., 2002. p. 2217-2222 1201887 (ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age; Vol. 5).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hwang, YS & Rim, HC 2002, Decision tree decomposition-based complex feature selection for text chunking. in X Yao, K Fukushima, S-Y Lee, L Wang & JC Rajapakse (eds), ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age., 1201887, ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age, vol. 5, Institute of Electrical and Electronics Engineers Inc., pp. 2217-2222, 9th International Conference on Neural Information Processing, ICONIP 2002, Singapore, Singapore, 02/11/18. https://doi.org/10.1109/ICONIP.2002.1201887

Hwang YS, Rim HC. Decision tree decomposition-based complex feature selection for text chunking. In Yao X, Fukushima K, Lee SY, Wang L, Rajapakse JC, editors, ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age. Institute of Electrical and Electronics Engineers Inc. 2002. p. 2217-2222. 1201887. (ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age). doi: 10.1109/ICONIP.2002.1201887

Hwang, Young Sook ; Rim, Hae Chang. / Decision tree decomposition-based complex feature selection for text chunking. ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age. editor / Xin Yao ; Kunihiko Fukushima ; Soo-Young Lee ; Lipo Wang ; Jagath C. Rajapakse. Institute of Electrical and Electronics Engineers Inc., 2002. pp. 2217-2222 (ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age).

@inproceedings{b41cd95ea934485684e2c1e5d7f25f7e,

title = "Decision tree decomposition-based complex feature selection for text chunking",

abstract = "Incorporating a method of feature selection into a classification model often provides a number of advantages. In this paper we propose a new feature selection method based on the discriminative perspective of improving the classification accuracy. The feature selection method is developed for a classification model for text chunking. For effective feature selection, we utilize a decision tree as an intermediate feature space inducer. To select a more compact feature set with less computational load, we organized a partially ordered feature space according to the IGR distribution of features. Experimental results show that: (1) the computational complexity on high-dimensional feature space can be reduced by selecting features based on the decision tree decomposition; (2) the text chunking system using the proposed feature selection can significantly improve the performance compared with a decision tree classifier.",

author = "Hwang, {Young Sook} and Rim, {Hae Chang}",

note = "Publisher Copyright: {\textcopyright} 2002 Nanyang Technological University.; 9th International Conference on Neural Information Processing, ICONIP 2002 ; Conference date: 18-11-2002 Through 22-11-2002",

year = "2002",

doi = "10.1109/ICONIP.2002.1201887",

language = "English",

series = "ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "2217--2222",

editor = "Xin Yao and Kunihiko Fukushima and Soo-Young Lee and Lipo Wang and Rajapakse, {Jagath C.}",

booktitle = "ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing",

}

TY - GEN

T1 - Decision tree decomposition-based complex feature selection for text chunking

AU - Hwang, Young Sook

AU - Rim, Hae Chang

PY - 2002

Y1 - 2002

N2 - Incorporating a method of feature selection into a classification model often provides a number of advantages. In this paper we propose a new feature selection method based on the discriminative perspective of improving the classification accuracy. The feature selection method is developed for a classification model for text chunking. For effective feature selection, we utilize a decision tree as an intermediate feature space inducer. To select a more compact feature set with less computational load, we organized a partially ordered feature space according to the IGR distribution of features. Experimental results show that: (1) the computational complexity on high-dimensional feature space can be reduced by selecting features based on the decision tree decomposition; (2) the text chunking system using the proposed feature selection can significantly improve the performance compared with a decision tree classifier.

AB - Incorporating a method of feature selection into a classification model often provides a number of advantages. In this paper we propose a new feature selection method based on the discriminative perspective of improving the classification accuracy. The feature selection method is developed for a classification model for text chunking. For effective feature selection, we utilize a decision tree as an intermediate feature space inducer. To select a more compact feature set with less computational load, we organized a partially ordered feature space according to the IGR distribution of features. Experimental results show that: (1) the computational complexity on high-dimensional feature space can be reduced by selecting features based on the decision tree decomposition; (2) the text chunking system using the proposed feature selection can significantly improve the performance compared with a decision tree classifier.

UR - http://www.scopus.com/inward/record.url?scp=84971673630&partnerID=8YFLogxK

U2 - 10.1109/ICONIP.2002.1201887

DO - 10.1109/ICONIP.2002.1201887

M3 - Conference contribution

AN - SCOPUS:84971673630

T3 - ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing: Computational Intelligence for the E-Age

SP - 2217

EP - 2222

BT - ICONIP 2002 - Proceedings of the 9th International Conference on Neural Information Processing

A2 - Yao, Xin

A2 - Fukushima, Kunihiko

A2 - Lee, Soo-Young

A2 - Wang, Lipo

A2 - Rajapakse, Jagath C.

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 9th International Conference on Neural Information Processing, ICONIP 2002

Y2 - 18 November 2002 through 22 November 2002

ER -

Decision tree decomposition-based complex feature selection for text chunking

Abstract

Publication series

Other

Bibliographical note

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this