Directory / Claim vetting
Laya's 0.766 benchmark accuracy
MisleadingNot yet tested by usLaya
The claim
Laya reaches 0.766 on the typed-decisions benchmark.
Our read
That score comes from a checkpoint fine-tuned on the benchmark's own training split. The zero-shot base scores 0.362. Convai's Jev comparisons also use Jev numbers from other people's runs.
Misleading: The numbers may be real, but the framing or comparison makes them look better than they are.
Test status
We haven't reproduced this yet. When we do, measured accuracy, latency, and cost will appear here next to the claimed figures.
Related entries
TypeSafe: 193.6× faster, 444.6× cheaper
Vendor claim by TypeSafe AI, added 15 Sep 2026
MisleadingNot yet tested by us
Jev is 40–200× faster and 40–400× cheaper than frontier LLMs, peaking at 193.6× and 444.6× on TypeSafe's workflows.
JevClaim vetting
“Jev can't hallucinate”
Vendor claim by Launch marketing, added 15 Sep 2026
MisleadingNot yet tested by us
Because outputs are typed, Jev cannot hallucinate.
JevClaim vetting
Laya: “6–8× faster than Jev”
Vendor claim by Convai Innovations, added 18 Sep 2026
MisleadingNot yet tested by us
At 32.8 ms per question on one GPU, Laya is 6 to 8 times faster than Jev.
LayaJevClaim vetting