@brunocabado built Decision Lab and ran JEV against LLMs on support tickets he labeled himself. He writes that decision models answer classification questions with a probability per option instead of generated text. The linked page is titled "Decision models vs LLMs: JEV, measured on tickets".
- 19 views
- 0 likes
- 0 bookmarks
- 0 reposts
Decision models like JEV answer classification questions with a probability per option instead of generated text. I wanted my own numbers before using them, so…
About this case
Benchmark. Bruno wanted his own numbers before using decision models, so he built a small lab and compared JEV with LLMs on support tickets he labeled. The post links to https://brunocabado.com/blog/decision-models-vs-llms/. The page title on the card is "Decision models vs LLMs: JEV, measured on tickets". Text only.
Original posthttps://x.com/brunocabado/status/2119353370561630565