In a recent experiment, physician-researchers at Beth Israel Deaconess Medical Center tested the ability of a publicly available chatbot, Chat-GPT 4, to make accurate diagnoses in challenging medical cases. The team found that the generative AI selected the correct diagnosis as its top diagnosis nearly 40 percent of the time and provided the correct diagnosis in its list of potential diagnoses in two-thirds of challenging cases. Generative AI chatbots are powerful tools that can revolutionize creative industries, education, customer service and more, and this experiment demonstrates their potential performance in the clinical setting.