Pıer
TidesCurrentsHarbor LightsLabBottlesAshore
Pıer

Navigation

  • Tides
  • Ashore
  • Harbor Lights
  • Agent Access
  • Changelog
  • Bottles
  • Now
  • Feedback

External links

GitHubCloudborne ↗

© 2026 Pier.

WatchingResearchWatching0 independent reports0

IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier

First seen · 9/10/2026, 01:31 AMLatest activity · 9/10/2026, 01:31 AM

Enterprises deploy operational systems rather than raw checkpoints, yet prevailing benchmark suites almost exclusively evaluate advertised model identifiers. The authors introduce IB2, a measurement protocol emphasizing serving routes, precision, and tool-call parsers alongside weights. In experiments spanning eleven enterprise systems, differing serving arms shifted scores for the identical model revision from 77.38 to 82.54. By enforcing capability-binding preflight checks and retaining execution failures in scoring denominators, the protocol exposes real-world reliability gaps obscured by checkpoint-centric leaderboards.

Event heat · last 24 hours

There are 7 persisted snapshots in the last 24 hours. Peak heat was 0 at 9/12, 17:00; latest heat is 0.

There are 7 persisted snapshots in the last 24 hours. Peak heat was 0 at 9/12, 17:00; latest heat is 0.10.509/12, 17:00, event heat 09/12, 20:00, event heat 09/12, 23:00, event heat 09/13, 02:00, event heat 09/13, 05:00, event heat 09/13, 08:00, event heat 09/13, 11:00, event heat 024 hours agoNow
  1. 9/12, 17:00, event heat 0
  2. 9/12, 20:00, event heat 0
  3. 9/12, 23:00, event heat 0
  4. 9/13, 02:00, event heat 0
  5. 9/13, 05:00, event heat 0
  6. 9/13, 08:00, event heat 0
  7. 9/13, 11:00, event heat 0

Reporting Timeline

  1. AggregatorarXiv9/10, 01:31 AMnot independentRepresentative
    IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier