Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
The Concordance Index decomposition: A measure for a deeper understanding of survival prediction models
Halmstad University, Sweden.
Halmstad University, Sweden; Lund University, Sweden.
RISE Research Institutes of Sweden, Digital Systems, Data Science. Halmstad University, Sweden.ORCID iD: 0000-0003-3272-4145
Halmstad University, Sweden.
2024 (English)In: Artificial Intelligence in Medicine, ISSN 0933-3657, E-ISSN 1873-2860, Vol. 148, article id 102781Article in journal (Refereed) Published
Abstract [en]

The Concordance Index (C-index) is a commonly used metric in Survival Analysis for evaluating the performance of a prediction model. In this paper, we propose a decomposition of the C-index into a weighted harmonic mean of two quantities: one for ranking observed events versus other observed events, and the other for ranking observed events versus censored cases. This decomposition enables a finer-grained analysis of the relative strengths and weaknesses between different survival prediction methods. The usefulness of this decomposition is demonstrated through benchmark comparisons against classical models and state-of-the-art methods, together with the new variational generative neural-network-based method (SurVED) proposed in this paper. The performance of the models is assessed using four publicly available datasets with varying levels of censoring. Using the C-index decomposition and synthetic censoring, the analysis shows that deep learning models utilize the observed events more effectively than other models. This allows them to keep a stable C-index in different censoring levels. In contrast to such deep learning methods, classical machine learning models deteriorate when the censoring level decreases due to their inability to improve on ranking the events versus other events. 

Place, publisher, year, edition, pages
Elsevier B.V. , 2024. Vol. 148, article id 102781
Keywords [en]
Concordance Index, Evaluation metric, Survival analysis, Variational encoder–decoder, Machine Learning, Neural Networks, Computer, Bioinformatics, Forecasting, Learning systems, Signal encoding, Encoder-decoder, Evaluation metrics, Fine-grained analysis, Performance, Prediction modelling, Survival prediction, Weighted harmonic means, artificial neural network, Deep learning
National Category
Mathematics
Identifiers
URN: urn:nbn:se:ri:diva-71927DOI: 10.1016/j.artmed.2024.102781Scopus ID: 2-s2.0-85184733529OAI: oai:DiVA.org:ri-71927DiVA, id: diva2:1841123
Note

This research was performed under the CAISR+ project funded by the Swedish Knowledge Foundation 

Available from: 2024-02-27 Created: 2024-02-27 Last updated: 2024-02-27Bibliographically approved

Open Access in DiVA

fulltext(1061 kB)158 downloads
File information
File name FULLTEXT01.pdfFile size 1061 kBChecksum SHA-512
ba538f9d78b8eacc9555f8d5dfac92e331170068fa2ec20136835f5ff909c9a78ff4f361625d3fa8e45cf96c15d194ec95d9813e03facc8dd8fa6bc523323e56
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Pashami, Sepideh

Search in DiVA

By author/editor
Pashami, Sepideh
By organisation
Data Science
In the same journal
Artificial Intelligence in Medicine
Mathematics

Search outside of DiVA

GoogleGoogle Scholar
Total: 158 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 10461 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf