Many healthcare leaders are expressing caution as hospitals and health systems increasingly adopt emerging AI technologies like generative AI and large language models to automate tedious tasks. They worry that these tools could potentially provide patients with inaccurate information or inadvertently cause harm. Michael Dowling, CEO of Northwell Health, acknowledges the potential of artificial intelligence to enhance healthcare delivery but also voices concerns about a future where machines could surpass human intelligence. In a recent interview with Politico, he emphasized the need for vigilance in not becoming overly reliant on highly advanced technology without fully comprehending its capabilities.

Sunil Dadlani, executive vice president and chief information and digital transformation officer of Atlantic Health System, also recognizes the promise of transforming healthcare with tools like ChatGPT but points out their limitations, including the lack of real-time data. Laura Smith, CIO of UnityPoint Health, highlights the potential unintended consequences if the data used to train these tools is biased, incomplete, or inaccurate. Similarly, Google Chief Health Officer Karen DeSalvo, MD, acknowledges the tremendous potential of AI in healthcare but emphasizes the importance of working through challenges to ensure the models are appropriately constrained, factual, consistent, and aligned with ethical and equity considerations.