Risks of Relying on AI Chatbots for Health Advice: A Study on Accuracy and Misinformation
Artificial intelligence chatbots have been found to provide information on alternatives to chemotherapy when asked, according to a recent study. The study evaluated various AI chatbots' responses to questions related to cancer, vaccines, stem cells, nutrition, and athletic performance. The researchers found that nearly half of the bots' responses were problematic, with some providing inaccurate or incomplete information. The study highlighted the potential risks of relying on AI chatbots for health advice, especially in areas where misinformation is prevalent.
The study, published in BMJ Open, revealed that some AI chatbots struggled to provide accurate and comprehensive responses to medical science questions. While some responses were somewhat problematic, others were highly problematic, leaving room for subjective interpretation. The study also found that the quality of responses was generally similar across the different chatbots, with Grok performing the worst. This underscores the importance of ensuring the accuracy and reliability of AI chatbot responses to medical queries.
Despite the increasing use of AI for health information and advice, the study emphasized the need for caution when relying on AI chatbots for medical guidance. Dr. Michael Foote, an assistant attending professor at Memorial Sloan Kettering Cancer Center, warned about the deceptive information online regarding alternative treatments and the potential harm they can cause. The study also highlighted the importance of distinguishing between scientifically backed treatments and alternative therapies that may not have sufficient evidence to support their efficacy.
The study raised concerns about the public health risks associated with flawed AI responses to medical queries. Dr. Ashwin Ramaswamy, an instructor of urology at Mount Sinai Hospital in New York City, noted that efforts to improve the safety and reliability of AI technology in healthcare are lagging behind. He emphasized the need for greater transparency and trust in AI systems to ensure that they provide accurate and evidence-based information to users. As the use of AI in healthcare continues to grow, addressing the challenges of misinformation and ensuring the accuracy of AI chatbot responses will be crucial in safeguarding patient health and well-being.