MiS Preprint Repository

We have decided to discontinue the publication of preprints on our preprint server as of 1 March 2024. The publication culture within mathematics has changed so much due to the rise of repositories such as ArXiV ( that we are encouraging all institute members to make their preprints available there. An institute's repository in its previous form is, therefore, unnecessary. The preprints published to date will remain available here, but we will not add any new preprints here.

MiS Preprint

Adaptive sequential feature selection for pattern classification

Liliya Avdiyenko, Nils Bertschinger and Jürgen Jost


Feature selection helps to focus resources on relevant dimensions of input data. Usually, reducing the input dimensionality to the most informative features also simplifies subsequent tasks, such as classification. This is, for instance, important for systems operating in online mode under time constraints. However, when the training data is of limited size, it becomes difficult to define a single small subset of features sufficient for classification of all data samples. In such situations, one should select features in an adaptive manner, i.e. use different feature subsets for every testing sample. Here, we propose a sequential adaptive algorithm that for a given testing sample selects features maximizing the expected information about its class. We provide experimental evidence that especially for small data sets our algorithm outperforms two the most similar information-based static and adaptive feature selectors.

MSC Codes:
Adaptivity, Feature Selection, mutual information, Multivariate Density Estimation, Pattern Recognition

Related publications

2012 Repository Open Access
Liliya Avdiyenko, Nils Bertschinger and Jürgen Jost

Adaptive sequential feature selection for pattern classification

In: Proceedings of the 4th International Conference on Neural Computation Theory and Applications (NCTA 2012), part of the International Joint Conference of Computational Intelligence (IJCCI), Barcelona, Spain, October 5-7, 2012
[S.l.] : INSTICC, 2012. - pp. 474-482