LLMs Struggle with Multimodal Physics Problems

A study on arXiv evaluates three large language models (Claude, Gemini, ChatGPT) on multimodal physics problems from the OpenStax database. While all models achieved 96% accuracy on text-only problems, performance dropped substantially on multimodal tasks. The research develops an empirical error taxonomy and tests a structured dialogue intervention to address multimodal processing limitations.