Deep Ordinal Classification Based on the Proportional Odds Model

Áreas de investigación:

• Applications - Health
• Methodology - Machine learning

Año:

2019

Tipo de publicación:

Artículo en conferencia

Palabras clave:

Ordinal regression, Ordinal classification, Proportional odds model, Deep learning, Convolutional neural network

Autores:

• Vargas, Víctor Manuel
• Gutiérrez, Pedro Antonio
• Hervás-Martínez, César

Volumen:

11487

Título del libro:

Proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation (IWINAC 2019)

Serie:

Lecture Notes in Computer Science (LNCS)

Páginas:

441-451

Organización:

Almería (España)

Mes:

3-7 junio

ISBN:

978-3-030-19650-9

BibTex:

@conference{Vargas2019Deep, author = "V{\'i}ctor Manuel Vargas and Pedro Antonio Guti{\'e}rrez and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "This paper proposes a deep neural network model for ordinal regression problems based on the use of a probabilistic ordinal link function in the output layer. This link function reproduces the Proportional Odds Model (POM), a statistical linear model which projects each pattern into a 1-dimensional space. In our case, the projection is estimated by a non-linear deep neural network. After that, patterns are classified using a set of ordered thresholds. In order to further improve the results, we combine this link function with a loss cost that takes the distance between classes into account, based on the weighted Kappa index. The experiments are based on two ordinal classification problems, and the statistical tests confirm that our ordinal network outperforms the nominal version and other proposals considered in the literature.", booktitle = "Proceedings of the International Work-Conference on the Interplay Between Natural and Artificial Computation (IWINAC 2019)", doi = "10.1007/978-3-030-19651-6_43", isbn = "978-3-030-19650-9", keywords = "Ordinal regression, Ordinal classification, Proportional odds model, Deep learning, Convolutional neural network ", month = "3-7 junio", organization = "Almer{\'i}a (Espa{\~n}a)", pages = "441-451", series = " Lecture Notes in Computer Science (LNCS)", title = "{D}eep {O}rdinal {C}lassification {B}ased on the {P}roportional {O}dds {M}odel", url = "doi.org/10.1007/978-3-030-19651-6_43", volume = "11487", year = "2019", }

Abstract:

This paper proposes a deep neural network model for ordinal regression problems based on the use of a probabilistic ordinal link function in the output layer. This link function reproduces the Proportional Odds Model (POM), a statistical linear model which projects each pattern into a 1-dimensional space. In our case, the projection is estimated by a non-linear deep neural network. After that, patterns are classified using a set of ordered thresholds. In order to further improve the results, we combine this link function with a loss cost that takes the distance between classes into account, based on the weighted Kappa index. The experiments are based on two ordinal classification problems, and the statistical tests confirm that our ordinal network outperforms the nominal version and other proposals considered in the literature.