AI Teaching Assistant Plugin for Moodle Uses RAG to Reduce Hallucinations
The AI Teaching & Learning Assistant, a new modular plugin for Moodle, employs Retrieval-Augmented Generation (RAG) to deliver reliable educational assistance without hallucinations. Its design focuses on two main aspects: interactive Socratic tutoring for learners and a workspace for teachers to oversee content creation. By anchoring responses from Large Language Models in materials provided by educators, it seeks to minimize misinformation and enhance deep understanding of concepts. The plugin was assessed using the Ragas framework and an initial user study, achieving faithfulness scores as high as 0.97 and a recommendation rate of 4.00 out of 5.00. Details about the system can be found in a demo paper available on arXiv.
Key facts
- The AI Teaching & Learning Assistant is a Moodle plugin.
- It uses Retrieval-Augmented Generation (RAG) to reduce hallucinations.
- The system has a dual-centric design for students and educators.
- Students receive interactive Socratic-based tutoring.
- Educators have a human-in-the-loop workspace for supervised content generation.
- LLM responses are grounded in teacher-provided materials.
- Evaluation used the Ragas (LLM-as-a-Judge) framework.
- Faithfulness scores reached up to 0.97.
- Recommendation rate was 4.00/5.00.
- The demo paper is available on arXiv.
Entities
Institutions
- Moodle
- arXiv