Artificial intelligence (AI) technologies are becoming increasingly prevalent in healthcare, offering potential improvements in various aspects of patient care and operational efficiency. However, the use of AI tools in a healthcare setting requires careful evaluation within a comprehensive governance framework to ensure safety, effectiveness, and ethical considerations.
One crucial aspect of evaluating vendor-provided AI technologies is understanding and assessing the risks associated with their use in clinical settings. To facilitate this process, healthcare organizations can categorize risks into four main areas: correctness and transparency, fairness and equity, integrated workflow, and safety and privacy. By identifying and grading risks in each category, organizations can make informed decisions about the adoption of AI tools and develop appropriate risk mitigations.
Glenn Wasson, an expert in analytics at UVA Health, emphasizes the importance of establishing a robust governance framework to interact with vendor products effectively. This framework allows healthcare organizations to leverage the benefits of commercial AI systems while minimizing risks and maintaining public trust. Wasson will be sharing insights on this topic in an educational session at HIMSS25 titled “Dear AI Vendors: This Is What We Need.”
In his role at UVA Health, Wasson oversees data curation and analysis for patient care and research, tackling a wide range of challenges from predictive care at the bedside to hospital ranking algorithms. He emphasizes the need for healthcare organizations to understand the unique risks associated with AI tools compared to traditional software and engage in a transparent dialog with vendors to address these risks effectively.
During his HIMSS25 session, Wasson will focus on the various applications of AI in healthcare, highlighting the collaborative workflows between AI systems and human decision-makers. By discussing different use cases and the associated risks, attendees will gain a deeper understanding of AI system evaluation and the importance of ongoing dialogues between providers and vendors.
Ultimately, Wasson aims for attendees to leave his session with a comprehensive framework for evaluating AI systems, considering factors such as data sets, workflows, and qualitative/quantitative assessments. This dialogue is not limited to AI professionals but should involve leaders and operators who understand the deployment environment and workflows. The dynamic nature of advanced AI systems necessitates continuous evaluation and adaptation to ensure safe and effective use in healthcare settings.
If you are attending HIMSS25, be sure to check out Glenn Wasson’s session on Tuesday, March 4, to gain valuable insights into evaluating AI technologies in healthcare. Follow Bill’s coverage of HIMSS on LinkedIn and stay updated on the latest developments in healthcare IT.
