Skip to content

@SaadMRP: Jev diagnoses SREGym-Lite faults; LLM review lifts pass rate 78.1%→89.5% across 21 faults, ~38s avg.

Benchmarks

Pial @SaadMRP

EN

  • 52 views
  • 0 likes
  • 0 bookmarks
  • 0 reposts
Poster from Pial (@SaadMRP)

About this case

Benchmark thread (1/8) with chart. Jev investigates system failures; an LLM checks the diagnosis. Across 21 SREGym-Lite faults, review raised pass rate from 78.1% to 89.5%, diagnoses averaging 38 seconds. For people evaluating Jev on ops/incident diagnosis.

Original posthttps://x.com/SaadMRP/status/2112699562511179838

Related cases