Michal Haindl Josef Kittler Fabio Roli (Eds.)

Multiple Classifier Systems

7th International Workshop, MCS 2007 Prague, Czech Republic, May 23-25, 2007 Proceedings

Springer

Table of Contents

Kernel-Based Fusion

Combining Pattern Recognition Modalities at the Sensor Level Via Kernel Fusion 1

Vadim Mottl, Alexander Tatarchuk, Valentina Sulimova, Olga Krasotkina, and Oleg Seredin

The Neutral Point Method for Kernel-Based Combination of Disjoint Training Data in Multi-modal Pattern Recognition 13

David Windridge, Vadim Mottl, Alexander Tatarchuk, and Andrey Eliseyev

Kernel Combination Versus Classifier Combination 22 Wan-Jui Lee, Sergey Verzakov, and Robert P. W. Duin

Deriving the Kernel from Training Data 32 Stefano Merler, Giuseppe Jurman, and Cesare Furlanello

Applications

On the Application of SVM-Ensembles Based on Adapted Random Subspace Sampling for Automatic Classification of NMR Data 42

Kai Lienemann, Thomas Plötz, and Gernot A. Fink

A New HMM-Based Ensemble Generation Method for Numeral Recognition 52

Albert Hung-Ren Ko, Robert Sabourin, and Alceu de Souza Britto Jr.

Classifiers Fusion in Recognition of Wheat Varieties 62 Sarunas Raudys, Omer Kaan Baykan, Ahmet Babalik, Vitalij Denisov, and Antanas Andrius Bielskis

Multiple Classifier Methods for Offline Handwritten Text Line Recognition 72

Roman Bertolami and Horst Bunke

Applying Data Fusion Methods to Passage Retrieval in QAS 82 Hans Ulrich Christensen and Daniel Ortiz-Arroyo

A Co-training Approach for Time Series Prediction with Missing Data 93

Tawfik A. Mohamed, Neamat El Gayar, and Amir F. Atiya

An Improved Random Subspace Method and Its Application to EEG Signal Classification 103

Shiliang Sun

VIII Table of Contents

Ensemble Learning Methods for Classifying EEG Signals 113 Shiliang Sun

Confidence Based Gating of Colour Features for Face Authentication . . . 121 Mohammad T. Sadeghi, Samaneh Khoshrou, and Josef Kittler

View-Based Eigenspaces with Mixture of Experts for View-Independent Face Recognition 131

Reza Ebrahimpour, Ehsanollah Kabir, and Mohammad Reza Yousefi

Fusion of Support Vector Classifiers for Parallel Gabor Methods Applied to Face Verification 141

Angel Serrano, Isaac Martin de Diego, Cristina Conde, Enrique Cabello, Li Bai, and Liniin Shen

Serial Fusion of Fingerprint and Face Matchers 151 Gian Luca Marcialis and Fabio Roli

Boosting

Boosting Lite - Handling Larger Datasets and Slower Base Classifiers 161

Lawrence 0. Hall, Robert E. Banfield, Kevin W. Bowyer, and W. Philip Kegelmeyer

Information Theoretic Combination of Classifiers with Application to AdaBoost 171

Julien Meynet and Jean-Philippe Thiran

Interactive Boosting for Image Classification 180 Yijuan Lu, Qi Tian, and Thomas S. Huang

Cluster and Graph Ensembles

Group-Induced Vector Spaces 190 Manuele Bicego, Elzbieta Pekalska, and Robert P. W. Duin

Selecting Diversifying Heuristics for Cluster Ensembles 200 Stefan T. Hadjitodorov and Ludmila I. Kuncheva

Unsupervised Texture Segmentation Using Multiple Segmenters Strategy 210

Michal Haindl and Stanislav Mikes

Classifier Ensembles for Vector Space Embedding of Graphs 220 Kaspar Riesen and Horst Bunke

Cascading for Nominal Data 231 Jesus Maudes, Juan J. Rodriguez, and Cesar Garcia-Osorio

Table of Contents IX

Feature Subspace Ensembles A Combination of Sample Subsets and Feature Subsets in One-Against-Other Classifiers 241

Mineichi Kudo, Satoshi Shirai, and Hiroshi Tenmoto

Random Feature Subset Selection for Ensemble Based Classification of Data with Missing Features 251

Joseph DePasquale and Robi Polikar

Feature Subspace Ensembles: A Parallel Classifier Combination Scheine Using Feature Selection 261

Hugo Silva and Ana Fred

Stopping Criteria for Ensemble-Based Feature Selection 271 Terry Windeatt and Matthew Prior

Multiple Classifier System Theory

On Rejecting Unreliably Classified Patterns 282 Pasquale Foggia, Gennaro Percannella, Carlo Sansone, and Mario Vento

Bayesian Analysis of Linear Combiners 292 Battista Biggio, Giorgio Fumera, and Fabio Roli

Applying Pairwise Fusion Matrix on Fusion Functions for Classifier Combination 302

Albert Hung-Ren Ko, Robert Sabourin, and Alceu de Souza Britto Jr.

Modelling Multiple-Classifier Relationships Using Bayesian Belief Networks 312

Samuel Chindaro, Konstantinos Sirlantzis, and Michael Fairhurst

Classifier Combining Rules Under Independence Assumptions 322 Shoushan Li and Chengqing Zong

Embedding Reject Option in ECOC Through LDPC Codes 333 Claudio Marrocco, Paolo Simeone, and Francesco Tortorella

Intramodal and Multimodal Fusion of Biometrie Experts

On Combination of Face Authentication Experts by a Mixture of Quality Dependent Fusion Classifiers 344

Norman Poh, Guillaume Heusch, and Josef Kittler

Index Driven Combination of Multiple Biometrie Experts for AUC Maximisation 357

Roberto Tronci, Giorgio Giacinto, and Fabio Roli

X Table of Contents

Q — stack: Uni- and Multimodal Classifier Stacking with Quality Measures 367

Krzysztof Kryszczuk and Andrzej Drygajlo

Reliability-Based Voting Scheines Using Modality-Independent Features in Multi-classifier Biometrie Authentication 377

Jonas Richiardi and Andrzej Drygajlo

Optimal Classifier Combination Rules for Verification and Identification Systems 387

Sergey Tulyakov, Venu Govindaraju, and Chaohong Wu

Majority Voting

Exploiting Diversity in Ensembles: Improving the Performance on Unbalanced Datasets 397

Nitesh V. Chawla and Jared Sylvester

On the Diversity-Performance Relationship for Majority Voting in Classifier Ensembles 407

Yun-Sheng Chung, D. Frank Hsu, and Chuan Yi Tang

Hierarchical Behavior Knowledge Space 421 Hubert Cecotti and Abdel Belai'd

Ensemble Learning

A New Dynamic Ensemble Selection Method for Numeral Recognition 431

Albert Hung-Ren Ko, Robert Sabourin, and Alceu de Souza Britto Jr.

Ensemble Learning in Linearly Combined Classifiers Via Negative Correlation 440

Manuela Zanda, Gavin Brown, Giorgio Fumera, and Fabio Roli

Naive Bayes Ensembles with a Random Oracle 450 Juan J. Rodriguez and Ludmila I. Kuncheva

An Experimental Study on Rotation Forest Ensembles 459 Ludmila I. Kuncheva and Juan J. Rodriguez

Cooperative Coevolutionary Ensemble Learning 469 Daniel Kanevskiy and Konstantin Vorontsov

Robust Inference in Bayesian Networks with Application to Gene Expression Temporal Data 479

Omer Berkman and Nathan Intrator

An Ensemble Approach for Incremental Learning in Nonstationary Environments 490

Michael D. Muhlbaier and Robi Polikar

Table of Contents XI

Invited Papers

Multiple Classifier Systems in Remote Sensing: From Basics to Recent Developments 501

Jon Atli Benediktsson, Jocelyn Chanussot, and Mathieu Fauvel

Biometrie Person Authentication Is a Multiple Classifier Problem 513 Samy Bengio and Johnny Mariethoz

Author Index 523