Study: Can AI chatbots accurately answer patient questions regarding vasectomies? Image Credit: Fabian Montano Hernandez / Shutterstock ChatGPT provided the most accurate and concise answers to frequently asked vasectomy questions compared to Gemini (formerly Bard) and Copilot (formerly Bing), making it a reliable patient resource. In a recent study published in the journal IJIR: Your Sexual Medicine Journal , researchers evaluated the efficacy and accuracy of three common generative artificial intelligence (AI) chatbots in answering basic healthcare questions. Specifically, they investigated ChatGPT-3.
5, Bing Chat, and Google Bard's performance when answering questions related to vasectomies. Critical assessment by a team of qualified urologists revealed that while all models performed satisfactorily across the ten common question tests, the ChatGPT algorithm attained the highest average score (1.367), significantly outperforming Bing Chat and Google Bard (p=0.
03988 and p=0.00005, respectively). Encouragingly, with the exception of Google Bard (now 'Gemini') presenting one 'unsatisfactory' response to the question, 'Does a vasectomy hurt?', all generative AI responses were rated either 'satisfactory' or 'excellent.
' Together, these results highlight the benefits of generative AI development in the healthcare industry, particularly when used to answer basic and common patient questions in an accurate and timely manner. However, the study authors caution that while these resul.