AI in Radiology: Benchmarking LLMs, Agentic Hype, and Imaging Informatics | Satvik Tripathi

Description

If you have ever watched a radiology AI demo hit 98% accuracy in testing and then wonder why nobody is actually using it in the clinic, this episode is for you. Hit subscribe so you never miss a conversation like this one.Jason sits down with Satvik Tripathi, incoming Medical Physics and Imaging Informatics PhD student at the University of Pennsylvania, AI scientist for RAD-AID International, and one of the sharpest voices in the field on the gap between research performance and real clinical value. Satvik has been working at the intersection of AI and radiology since 2019 and brings a perspective that cuts through the noise.They get into the hard questions: why multiple-choice benchmarks are a terrible way to evaluate medical LLMs, what data leakage is quietly doing to published performance numbers, and why a fine-tuned model is not always the winner in a clinical context. Satvik also breaks down what it actually takes to build a benchmark that means something, and shares early findings from his team's head-to-head testing of over 20 models on an internally annotated clinical dataset.The conversation also digs into agentic AI in imaging informatics, global health deployments through RAD-AID in Botswana and India, AI-assisted oncology workflows, and why running smaller open-source models locally might be smarter than everyone thinks. Plus, Satvik makes a case that prompt engineering is not a productivity shortcut but a legitimate scientific method.Whether you are a PACS administrator, imaging analyst, radiology IT professional, or just someone trying to figure out which AI tools are actually worth your time, this is the kind of conversation that helps you cut through the hype and think more clearly about what is coming.If this episode is useful to you, please subscribe, leave a review, and share it with a colleague in the imaging informatics community. It makes a real difference. And if you are working toward your CIIP credential or want to go deeper on the foundations of this field, check out the CIIP Foundation