Skip to content

@skalskip92 says he started building a benchmark for vision decision models, expecting to trade accuracy for speed. On his numbers, GPT-6.1 Terra (high) was 96/100 correct at 7.98 s average per image, and TypeSafe AI Jev 1.14 was 89/100 correct at 9.64 s average per image. He asks why decision models are so slow.

Benchmarks

SkalskiP @skalskip92

EN

  • 9.9k views
  • 141 likes
  • 51 bookmarks
  • 1 reposts
started building a benchmark for vision decision models was expecting to trade accuracy for speed... meanwhile... - GPT-6.1 Terra (high): 96/100 correct, 7.98s…

About this case

Benchmark. SkalskiP (@skalskip92) posts text only. No link.

Original posthttps://x.com/skalskip92/status/2122735955593617590

Related cases