DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat

DungeonBench evaluates rules-rich tactical reasoning through Dungeons & Dragons combat based on combat-relevant content from the 2014 System Reference Document. Each decision exposes a full tactical observation and indexed executable options covering movement, attacks, spells, reactions, objectives, preparation, and scarce resources. Its Encounter track measures play within individual fights, while the Day track carries hit points, spell slots, consumables, preparation, and rest timing across encounters. According to the supplied abstract, frontier language-model policies often win isolated encounters but remain weak at long-horizon resource budgeting, rest timing, and rule-aware tactical discipline.