Discussion (6 Comments)Read Original on HackerNews

prathje•10 minutes ago

Nice! I would love to use it for images as well. Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching? Because then I have been using that already…

bicsi•39 minutes ago

Of course it works, Jev is nothing but an API breakthrough

dist-epoch•9 minutes ago

Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve.

Havoc•about 2 hours ago

Likely works even better with fireworks ai since they have proper grammar support

allanrbo•about 2 hours ago

Ah, will try, thanks!

Mashimo•35 minutes ago

[A] Hotdog

[B] Not a hotdog

A single function Jev-like wrapper for LLMs, including vision models

⚡ Community Insights

Discussion (6 Comments)Read Original on HackerNews