DE version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
88% Positive
Analyzed from 688 words in the discussion.
Trending Topics
#jev#models#using#while#model#output#set#decision#every#classification

Discussion (37 Comments)Read Original on HackerNews
I understand the hype but I wonder: what are the use cases for this kind of model? Could it be used in the context of coding agents, or is it more relevant in totally different situations?
For coding agents it'd only be useful in a subset of situations. E.g. you could imagine using one to classify bash tool calls into safe and unsafe for example.
My understanding is: it takes text input and it does one shot classification (no training data)
As a corollary, the output classes can be any set, rather than needing to be set before training.
My guess would be option 1. Didn’t read the kev repo here which would also explain
prompt_eval=244 ms wall=245 ms schema_cache=hit generated=0
Move limit reached after 200 moves: score=16, length=19.
So, if a 12B dense model can offer this latency on a local old PC, then definitely you can scale it up with more powerful machines and get even lower latency.