Skip to content

@p0 (Parallel Web Systems) says on a generic decisions benchmark OpenAI, Jev, and Parallel all score about 90%, but on live-web questions OpenAI drops 2.2× and Jev drops 2.6×. They built PWS-Decisions so generic benches cannot hide that gap, and link the benchmark blog.

Benchmarks

Parallel Web Systems @p0

EN

  • 835 views
  • 14 likes
  • 4 bookmarks
  • 1 reposts
On a generic decisions benchmark, OpenAI, Jev, and Parallel all score about 90%. On questions that depend on the live web, OpenAI drops 2.2x, and Jev drops 2.6x…

About this case

Benchmark post. Parallel Web Systems (@p0) reports ~90% for OpenAI, Jev, and Parallel on a generic decisions bench, then 2.2× and 2.6× drops for OpenAI and Jev on live-web questions. They introduce PWS-Decisions and link https://parallel.ai/blog/pws-decisions-benchmark with a chart image.

Original posthttps://x.com/p0/status/2118456575761473863

Related cases