Most GUI benchmarks evaluate agents inside isolated, static environments, overlooking how workflows actually cross devices. JarvisGUI establishes a unified evaluation framework across Android, Windows, and Ubuntu, formalizing tasks as typed input-output transformations to compose multi-device workflows dynamically. Experiments in multi-OS virtual environments reveal that leading open-source agents struggle with state-transfer awareness and cross-platform contextual reasoning, exposing capability gaps that single-device evaluations hide.
There are 3 persisted snapshots in the last 24 hours. Peak heat was 0 at 9/12, 20:00; latest heat is 0.