A single function Jev-like wrapper for LLMs, including vision models

aallanrbo about 4 hours ago 6 commentsRead Article on allanrbo.blogspot.com

⚡ Community Insights

Discussion Sentiment

100% Positive

Analyzed from 94 words in the discussion.

Discussion (6 Comments)Read Original on HackerNews

prathje•13 minutes ago

Nice! I would love to use it for images as well. Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching? Because then I have been using that already…

bicsi•43 minutes ago

Of course it works, Jev is nothing but an API breakthrough

dist-epoch•12 minutes ago

Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve.

Havoc•about 2 hours ago

Likely works even better with fireworks ai since they have proper grammar support

allanrbo•about 2 hours ago

Ah, will try, thanks!

Mashimo•38 minutes ago

[A] Hotdog

[B] Not a hotdog