In a recent experiment, physician-researchers at Beth Israel Deaconess Medical Center tested the ability of a publicly available chatbot, Chat-GPT 4, to make accurate diagnoses in challenging medical cases. The team found that the generative AI was able to select the correct diagnosis as its top diagnosis nearly 40 percent of the time and provided the correct diagnosis in its list of potential diagnoses in two-thirds of challenging cases. Generative AI refers to a type of artificial intelligence that uses patterns and information it has been trained on to create new content, such as chatbots, which use natural language processing (NLP) to understand, interpret and generate human-like language. This experiment demonstrates the potential of generative AI chatbots to revolutionize creative industries, education, customer service and more, including the clinical setting.
