The use of AI-powered search engines and chatbots for obtaining information on drugs may not always be accurate and safe for patients, according to a study published in the journal BMJ Quality & Safety. The researchers found that a significant number of answers provided by these chatbots were incorrect or potentially harmful, and the complexity of the answers might make it challenging for patients to understand without a higher level of education.
In February 2023, search engines introduced AI-powered chatbots, promising enhanced search results and interactive experiences. However, while these chatbots can access vast amounts of information from the internet, they are also capable of generating misinformation and harmful content.
To assess the readability, completeness, and accuracy of chatbot answers for queries about the top 50 most prescribed drugs in the US, researchers used Bing copilot, a search engine with AI chatbot features. They asked the chatbot 10 questions for each drug, covering usage, mechanisms, side effects, and contraindications.
The study revealed that the readability of chatbot answers required a degree-level education, with even the most readable answers necessitating a high school level of understanding. While the completeness of answers varied, with some questions answered fully and others lacking information, the accuracy of the responses was found to be inconsistent with scientific consensus in some cases.
Furthermore, the study found that following the chatbot’s advice could potentially lead to harm, with a significant percentage of answers rated as likely to cause moderate to severe harm or even death.
The researchers caution against relying solely on AI-powered search engines and emphasize the importance of consulting healthcare professionals for accurate information on medications. They recommend exercising caution in using these chatbots until their accuracy rates improve.
In conclusion, while AI-powered chatbots in search engines have the potential to provide valuable information, patients should be mindful of the limitations and potential risks associated with relying on them for medical advice. Consulting healthcare professionals remains essential for accurate and safe drug information.
