Skip to content

@brunocabado built Decision Lab and ran JEV against LLMs on support tickets he labeled himself. He writes that decision models answer classification questions with a probability per option instead of generated text. The linked page is titled "Decision models vs LLMs: JEV, measured on tickets".

Benchmarks

Sr. Bruno @brunocabado

EN

  • 19 views
  • 0 likes
  • 0 bookmarks
  • 0 reposts
Decision models like JEV answer classification questions with a probability per option instead of generated text. I wanted my own numbers before using them, so…

About this case

Benchmark. Bruno wanted his own numbers before using decision models, so he built a small lab and compared JEV with LLMs on support tickets he labeled. The post links to https://brunocabado.com/blog/decision-models-vs-llms/. The page title on the card is "Decision models vs LLMs: JEV, measured on tickets". Text only.

Original posthttps://x.com/brunocabado/status/2119353370561630565

Related cases