Topic: gap between benchmarks usability

Human Input Key to Effective Chatbot Testing, Oxford Study Finds

While AI models like LLMs achieve high accuracy (94.9%) in isolated medical tests, real-world human users leveraging them for diagnoses saw much lower accuracy (34.5%), often underperforming self-diagnosis methods. The Oxford study revealed key issues: incomplete user prompts and AI misinterpreta...