A Verifier-Guided Explainable Reasoning Framework with RLVR and Symbolic Solvers
Original title:A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
To address fragile and ungrounded step-by-step reasoning in compact models, this paper couples Qwen2.5-3B-Instruct with external symbolic verifiers and group-relative reinforcement learning with verifiable rewards (RLVR). A lightweight router directs logic problems to Z3 and physics tasks to unit-aware solvers, using verification signals for candidate scoring and revision. Across 438 test cases, the approach lifted reasoning depth and explainability from 50.68% to 72.20% while preserving answer accuracy. By separating generative narrative from deterministic verification, the framework provides a pragmatic design for reliable educational QA.
Why it's worth reading
It offers a practical reference for resource-constrained setups, demonstrating how pairing a 3B model with external symbolic verifiers and RLVR strengthens reasoning depth without sacrificing answer reliability.