SciOly PrepBot: An Agentic AI Framework for Creating Practice Tests
Science Olympiad is a nation-wide STEM competition where students compete in events in biology, chemistry, physics, and engineering. Each event is governed by rules that define the scope of content, test format, and scoring methodology. This project investigates whether agentic AI systems or teams of cooperative AI agents can create high-quality, well-written and appropriately challenging practice tests. The AI-generated tests are compared with human-authored tests from Invitational tournaments to assess the strengths and weaknesses of agentic AI for this task.