HyperAIHyperAI

Command Palette

Search for a command to run...

5 months ago

Explainable Prediction of Medical Codes from Clinical Text

James Mullenbach; Sarah Wiegreffe; Jon Duke; Jimeng Sun; Jacob Eisenstein

Explainable Prediction of Medical Codes from Clinical Text

Abstract

Clinical notes are text documents that are created by clinicians for each patient encounter. They are typically accompanied by medical codes, which describe the diagnosis and treatment. Annotating these codes is labor intensive and error prone; furthermore, the connection between the codes and the text is not annotated, obscuring the reasons and details behind specific diagnoses and treatments. We present an attentional convolutional network that predicts medical codes from clinical text. Our method aggregates information across the document using a convolutional neural network, and uses an attention mechanism to select the most relevant segments for each of the thousands of possible codes. The method is accurate, achieving precision@8 of 0.71 and a Micro-F1 of 0.54, which are both better than the prior state of the art. Furthermore, through an interpretability evaluation by a physician, we show that the attention mechanism identifies meaningful explanations for each code assignment

Code Repositories

dalgu90/icd-coding-benchmark
pytorch
Mentioned in GitHub
jamesmullenbach/caml-mimic
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
medical-code-prediction-on-mimic-iiiDR-CAML
Macro-AUC: 89.7
Macro-F1: 8.6
Micro-AUC: 98.5
Micro-F1: 52.9
Precision@15: 54.8
Precision@8: 69.0
medical-code-prediction-on-mimic-iiiBi-GRU
Macro-AUC: 82.2
Macro-F1: 3.8
Micro-AUC: 97.1
Micro-F1: 41.7
Precision@15: 44.5
Precision@8: 58.5
medical-code-prediction-on-mimic-iiiLogistic Regression
Macro-AUC: 56.1
Macro-F1: 1.1
Micro-AUC: 93.7
Micro-F1: 27.2
Precision@15: 41.1
Precision@8: 54.2
medical-code-prediction-on-mimic-iiiSVM
Micro-F1: 44.1
medical-code-prediction-on-mimic-iiiCNN
Macro-AUC: 80.6
Macro-F1: 4.2
Micro-AUC: 96.9
Micro-F1: 41.9
Precision@15: 44.3
Precision@8: 58.1
medical-code-prediction-on-mimic-iiiCAML
Macro-AUC: 89.5
Macro-F1: 8.8
Micro-AUC: 98.6
Micro-F1: 53.9
Precision@15: 56.1
Precision@8: 70.9

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp