Automating ICD-10 code assignment addresses the time-consuming, error-prone manual process that delays billing and compromises data quality. This project develops an AI-driven prediction system—leveraging sentence-BERT embeddings, a Retrieval-Augmented Generation (RAG) architecture, and large language models—to classify radiology reports into their appropriate ICD-10 codes. Initial experiments demonstrate that integrating domain-specific embeddings with LLMs can achieve high precision and recall, reducing administrative overhead and improving coding accuracy. The system’s performance will be evaluated using Top-1 accuracy, precision, recall, and F1-score against a labeled validation set. 

Watch the team present this project at 45:27 in the session recording here.

Keywords: ICD-10 Coding Automation; Natural Language Processing (NLP); Sentence-BERT Embeddings; Retrieval-Augmented Generation (RAG); Large Language Models (LLM); Radiology Report Classification; Healthcare AI; Coding Accuracy; Precision and Recall; Administrative Efficiency

Faculty Advisor

Dr. Pamuksuz, a professor of AI, specializes in applied mathematics, machine/deep learning, responsible and generative AI. He has contributed to various analytics journals, including IEEE Transactions on Artificial Intelligence, and has shared his insights at several national and international conferences.

Since joining the University of Chicago as a faculty member in 2018, Dr. Pamuksuz has taught a range of subjects, including data mining, machine learning, and linear & non-linear models, along with more specialized areas like AI-data science for leaders and Generative AI Research. His supervision of capstone theses has often centered on computer vision and natural language processing.

In the professional realm, Dr. Pamuksuz has an impressive record. He has led data science teams at several Fortune 500 companies, provided expert consultancy in architecting cloud-based machine learning solutions, and co-founded Inference Analytics in 2018. Under his leadership, Inference Analytics was recognized in 2023 as one of the top Machine Learning Companies in Illinois, marking a significant milestone in healthcare analytics in Chicago.

Dr. Pamuksuz’s academic path has taken him through some of Illinois’ most prestigious universities. He completed his MS in Computer Engineering/Science at Northwestern University and went on to earn his Ph.D. from UIUC. Today, he contributes his expertise as a faculty member at the University of Chicago. This journey, connecting three significant academic institutions, reflects a strong foundation and dedication to his field and a deep engagement with the state’s rich educational landscape. Outside of his professional endeavors, Dr. Pamuksuz is enthusiastic about hackathons, not only participating in several but also organizing them twice annually since 2020. His involvement has yielded notable success in various data challenges. As a sports fan, he follows Champions League Soccer, supporting Galatasaray, and enjoys engaging in basketball and volleyball during his leisure time. He also enjoys smooth/gypsy jazz where you can find him on Wednesdays in his favorite place Green Mill.

arrow-left-smallarrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-long-yellowarrow-right-smallclosefacet-arrow-down-whitefacet-arrow-downCheckedCheckedlink-outmag-glass