Nonlinear Ordinal Logistic Regression using covariates obtained by Radial Basis Function neural networks models

Research areas:

• Methodology - Machine learning

Year:

2015

Type of Publication:

In Proceedings

Authors:

• Dorado-Moreno, Manuel
• Gutiérrez, Pedro Antonio
• Sánchez-Monedero, Javier
• Hervás-Martínez, César

Volume:

9095

Book title:

13th International Work-Conference on Artificial Neural Networks (IWANN 2015)

Series:

Lecture Notes in Computer Science (LNCS)

Pages:

80-91

Organization:

Palma de Mallorca (Spain)

Month:

10th-12th June

ISBN:

978-3-319-19221-5

Abstract:

This paper proposes a nonlinear ordinal logistic regression method based on the hybridization of a linear model and radial basis function (RBF) neural network models for ordinal regression. The process for obtaining the coefficients is carried out in several steps. In the first step we use an evolutionary algorithm to determine the structure of the RBF neural network model, in a second step we transform the initial feature space (covariate space) adding the nonlinear transformations of the input variables given by the RBFs of the best individual in the final generation of the evolutionary algorithm. Finally, we apply an ordinal logistic regression in the new feature space. This methodology is tested using 8 benchmark problems from the UCI repository. The hybrid model outperforms both the linear and the nonlinear part obtaining a good compromise between them and better results in terms of accuracy and ordinal classification error.