GUEST LECTURE SERIES „MEDICAL INFORMATION SCIENCES“ CME Punkte, DIPL.-ING. (UNIV.) MATTHIAS KEICHER

DIPL.-ING. (UNIV.) MATTHIAS KEICHER, Research Manager at the Chair of Computer Aided Medical Procedures, Technical University of Munich

„Towards Clinical Reasoning Support Systems withMultimodal Foundation Models“

Clinical decision-making is a complex process that requires the integration of a wide
range of patient information and extensive medical knowledge. To effectively support
this process, clinical decision support systems should not only be able to form a holistic
view of the patient and consider prior knowledge but also be able to convey their
reasoning. In light of recent advances in large language models (LLMs), this talk
explores the potential of multimodal foundation models in enabling such systems. We
first discuss the clinical reasoning process and then present how the integration of
knowledge and multimodal patient representations in LLMs could interactively support
clinicians in their decision-making. Finally, recent works in radiology report generation
and conversational assistance are showcased to illustrate the potential impact of these
technologies on radiology and other medical fields.

Matthias Keicher is a senior PhD candidate and group leader at the Chair for Computer Aided Medical
Procedures at the Technical University of Munich (TUM) and the interdisciplinary research lab of the
hospital Klinikum rechts der Isar in Munich. He leads a research group focused on applying deep
learning for vision and language understanding in radiology and neuroradiology, focusing on topics
such as automated report generation, structured reporting, and visual question answering. His research
interests revolve around using multimodal deep learning to enable holistic clinical decision support
systems that can reason over comprehensive patient data. He graduated as a mechanical engineer at
TUM specializing in biomedical engineering. Before returning to academia, he gained several years of
industrial experience in the healthcare domain, working as a product manager, director of business
development, and eventually as CTO and managing director. He also co-founded a health technology
startup during this time.

Date: April 30th 2024 (starting 5:30 pm)
Place: Großer Hörsaal (University Hospital, second floor, Room 047)
The lecture will be live-streamed to lecture hall N2045 (FAI).