@elise_ai says they worked with @typesafeai to test Jev in the field. Their Maintenance App lets apartment maintenance techs photograph appliance labels instead of typing in model and serial numbers. If a photo is unreadable, they need to catch it before the technician walks away. They tested Jev, Sol and Opus on 140 labeled photos to see how quickly and accurately they could flag photos that needed a retake. In the follow-up, Jev caught 32 of 35 unreadable photos and incorrectly flagged two readable ones. Its median check took 94 ms, about 30× faster than Sol, at roughly 2% of the estimated cost. They write that these are training-set results. Next they are testing on new photos and measuring the full workflow from taking a photo to receiving a retake prompt.
- 3.1k views
- 19 likes
- 11 bookmarks
- 1 reposts
We worked with @typesafeai to test Jev in the field. Our Maintenance App lets apartment maintenance techs photograph appliance labels instead of typing in model…
About this case
Benchmark. Elise Labs (@elise_ai) attaches two photos to this post. The follow-up, with the 32 of 35 numbers, has its own chart photo, which is not part of this post. The post text has no URL.
Original posthttps://x.com/elise_ai/status/2122745913525350587