Title

Effect of Subsampling Rate on Subbagging and Related Ensembles of Stable Classifiers

Authors

Faisal Zaman, Hideo Hirose

Source

PReMI '09 Proceedings of the 3rd International Conference on Pattern Recognition and Machine Intelligence Pages 44-49
出版物名: Springer-Verlag Berlin, Heidelberg �2009
table of contents ISBN: 978-3-642-11163-1 doi>10.1007/978-3-642-11164-8_8

Abstract

In ensemble methods to create multiple classifiers mostly bootstrap sampling method is preferred. The use of subsampling in ensemble creation, produce diverse members for the ensemble and induce instability for stable classifiers. In subsampling the only parameter is the subsample rate that is how much observations we will take from the training sample in each subsample. In this paper we have presented our work on the effect of different subsampling rate (SSR) in bagging type ensemble of stable classifiers, Subbagging and Double Subbagging. We have used three stable classifiers, Linear Support Vector Machine (LSVM), Stable Linear Discriminant Analysis (SLDA) and Logistic Linear Classifier (LOGLC). We also experimented on decision tree to check whether the performance of tree classifier is influenced by different SSR. From the experiment we see that for most of the datasets, the subbagging with stable classifiers in low SSR produces better performance than bagging and single stable classifiers, also in some cases better than double subbagging. We also found an opposite relation between the performance of double subbagging and subbagging.

Key Words

Citation

Times Cited in Web of Science: 5

Times Cited in Scopus:

Times Cited in Google Scholar: 6

Inspec:

Cited in Books:

Cited in Proceedings:

WoS: IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING 巻: 20 号: 8 ページ: 2252-2264 DOI: 10.1109/TASL.2012.2199982 発行: OCT 2012; INTELLIGENT INFORMATION AND DATABASE SYSTEMS, ACIIDS 2011, PT II シリーズタイトル: Lecture Notes in Artificial Intelligence 巻: 6592 ページ: 272-281 発行: 2011; International Conference on Computational Science and Its Applications 開催地: Fukuoka, JAPAN 日付: MAR 20-28, 2010; 2nd Asian Conference on Intelligent Information and Database Systems (ACIIDS) 開催地: Hue City, VIETNAM 日付: MAR 24-26, 2010