Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

82% Positive

Analyzed from 1863 words in the discussion.

Trending Topics

#model#open#models#more#thinking#training#kimi#frontier#less#license

Discussion (105 Comments)Read Original on HackerNews

GodelNumbering•about 2 hours ago
This is the golden age of model training. Some days ago, I decided I wanted a local CPU only model that can perform exceptionally well for English to Bash translation (to avoid the googling for command syntax). I got a bunch of subagents to generate large amount of training data (140k+ samples), got the Qwen 3 0.6B base model, pointed Astra at it, and off to the races. It trained for 2 days (on and off) and I got a surprisingly good model for my task! The total active time I spent was a few hours. And it is still improving, what a time to be alive!
shriphani•about 2 hours ago
what hardware are you using to train?
GodelNumbering•about 2 hours ago
I didn't have a local GPU, so I asked it to go out and find hardware. It found a google TPU v6e which seemed reasonably priced. I gave it my google api key. I told it to use TPU only when training and bring it down afterwards. That's about it.
otterley•about 2 hours ago
What kind of observability did you have over this process? I’m interested in how my peers are operating these efforts.
shriphani•about 2 hours ago
Neat!
PEe9bB7D•about 2 hours ago
i also need more info!
GodelNumbering•about 2 hours ago
I am thinking about opensourcing everything, although this is not my main domain or my main startup, so the overhead of huggingface etc seems a bit unnecessary
netvarun•about 2 hours ago
Off topic:With sol pricing drop tbh kimi k3’s value prop has not been that great. For our internal use case/testing/benchmarks sol come out with way better quality and much cheaper costs. Kimi really needs to drop their pricing (I heard it’s set by them across all the neoclouds) Sol is at 2/10 vs kimi’s 3/15
drob518•about 2 hours ago
Agreed. Even on the open weight side, GLM 5.3 has roughly equivalent performance to Kimi K3 for less than half the cost.
nostrebored•about 2 hours ago
Agreed, I think the only place where it’s still interesting is ui design. Visually kimi and muse feel much nicer than frontier models to me, but maybe it’s an artifact of everything terrible being Claude Design
tangled•29 minutes ago
What am I missing here? I think of fireworks as an inference provider serving open weights model. The value that they primarily provide to customers is that (i) they improve reliability by balancing across a bunch of clouds/neoclouds, (ii) they get better pricing by buying capacity in bulk, and (iii) they reduce operational costs. So far so good.

I can also see the argument for providing a post-training service from a customer acquisition perspective: "hey, we can fine-tune this open weights model, so it both gives better/more predictable results than OpenAI/Anthropic and also is cheaper. And btw, once we've won your business, please run this model on our infra."

But what I'm struggling to understand is fireworks spending a bunch of money (on salaries and compute) releasing a frontier model that is going to rapidly fall behind the frontier. Is this "just" advertising for them, both for customers and also for hiring? Or are they actually trying to stay on the frontier? If so, to what end?

criemen•21 minutes ago
> to what end?

I'd expect that their business strategy is to compete in more markets, and if successful, they can capture more value. This is the "easiest" for them as they already have GPUs, a training environment etc. For that platform it's not the worst if there's an internal customer team that can help shape the future and provide immediate feedback, and if it results in a good model, even better.

Other things I'd not be surprised they offer in the future in the same vein: A multi-model harness, coding agent (cloud and local), and maybe at a later point in time even a CPU-only cloud compute product.

danielmarkbruce•23 minutes ago
The end: make lots of money. The means: systematically take existing reasoning models, do some more post-training of some sort to make them achieve the same outputs with less reasoning tokens (ie, cheaper). Same quality but cheaper is always valuable.

It's unclear if they can do this systematically and it's unclear if they can do it better than others. But, lots of things are unclear in AI at the moment, this doesn't seem outrageous on the surface. And, it could just be marketing. And it could be the first option with the backup of the second.

TomasEkeli•27 minutes ago
I think they are trying to show potential customers what is possible.
spdustin•25 minutes ago
Been thinking about the feasibility of training a model using synthetic thinking traces that were reduced to caveman-speak prior to being used for training. Seems like it would be fairly easy to generate plenty of suitably lobotomized synthetic traces with a pair of cheap-ish models. Or even just using good old fashioned NLP to aggressively remove stop words and reduce trace words to lemmas.
jamienk•about 2 hours ago
Ignoring for the moment issues of what "counts" as open, won't open models rapidly advance due to stuff like this in ways that it's less possible for the proprietary ones to do? This is exactly how Linux & Wikipedia, for example, overtook their "frontiers", right?
andsoitis•about 2 hours ago
> Ignoring for the moment issues of what "counts" as open, won't open models rapidly advance due to stuff like this in ways that it's less possible for the proprietary ones to do? This is exactly how Linux & Wikipedia, for example, overtook their "frontiers", right?

I suspect the advantage that catapulted Linux ahead of the establishment was less technical potential and talent and more organizational advantage. That's not to diminish the technical talent of the Linux crew, but them being unencumbered gave them more degrees of freedom. The rest is history.

So as long as the AI companies don't succumb to "big company" dynamics, they can outlead. To wit: Open AI and Anthropic are kicking Google's ass.

jamienk•about 2 hours ago
Diff people have diff motives to experiment, then new work is done on top of stuff that "hits" in a way no one anticipated. Then work gets piled on top in a way that might make it hard to port
andsoitis•about 2 hours ago
> then new work is done on top of stuff that "hits" in a way no one anticipated.

Indeed. And when you have freedom to play, you are able to find new stepping stones that you didn't anticipate. And you can combine stepping stones in new ways to make new discoveries.

Greatness cannot be planned.

segmondy•about 2 hours ago
No, because close labs/models borrow but don't contribute back.
swagatkonchada•about 2 hours ago
Won't the "frontier" labs figure out whatever techniques were used and apply them to their closed models?
cyanydeez•about 2 hours ago
Like how the last 2 decades of tech companies are thinly veiled open source pilfering into business units.
k__•about 2 hours ago
If they can keep up.

The lock-in is less pronounced as it is with AWS or MS.

zeroq•about 2 hours ago
The difference between contributing to OS and AI, is that the first is a hobby alternative to woodworking or hiking, while the other can easily bootstrap you a company you can get millions in investment, at least for time being.
intothemild•about 2 hours ago
Yes, absolutely, but only if people keep contributing in the open.
jack_pp•about 2 hours ago
not necessarily, just knowing something is possible will motivate others to achieve it somehow. Which is why there are so many LLMs and OAI doesn't have a monopoly
Arcuru•about 1 hour ago
Over on /r/LocalLLaMA there's a group that's been getting popular doing the same thing for the Qwen 27B (and other) models. - https://huggingface.co/ukisai
nico•about 2 hours ago
> The problem: thinking models think too much

This is partly the appeal of Jev et al; having a quick model for simple tasks, that doesn’t require that much thinking

It’s amazing all the workflows that models like that can unlock. And yes, classifiers and other ML models have been around for a while for these types of tasks, but Jev has made it easy and cheap to play and experiment. This in turn, is incentivizing people to try them for a bunch of stuff, unlocking creativity and producing a lot of new cool (and eventually potentially very useful) applications

elcomet•about 2 hours ago
Why not using a cheap LLM with thinking completely disabled ? I don't think it will be much more expensive than jev.
demibabs•about 2 hours ago
What are the useful applications of Jev so far? Not to sound dismissive, I just haven’t seen what people are using it for yet.
neosat•about 2 hours ago
Lots of use cases! I've personally used it for the following:

1. Evals (once you have your rubric defined and tuned using a reasoning model, jev can be great for running periodic evals especially those that run daily.

2. e-commerce catalog classification 3. quick search using anything as context and query mapping to a pre-defined set.

andsoitis•about 2 hours ago
> The problem: thinking models think too much

Analysis paralysis stifles not just human intelligence, but other intelligences too.

AraneaDev•about 1 hour ago
Yes and thar makes you wonder if the Paradox of Choice would apply as well ;)

The more options you have, the harder it becomes to be satisfied with the one you picked.

intothemild•about 2 hours ago
So they trained a model on open weights, and then aren't releasing the weights... am I reading this right?
DonsDiscountGas•about 2 hours ago
It happens. Most open licenses aren't GPL style copyleft.
netvarun•about 2 hours ago
Technically kimi k-3 weights license is not open weight (it has a lot of restrictions). I would classify it as ‘weight open’ similar to the bsl and fsl ’source open’ licenses.
Evidlo•about 2 hours ago
weight available
makeramen•about 2 hours ago
Aren't Cursor Composer models like this too? At some point all the extra RL you do can be considered as proprietary information added.

Not suggesting this is right or wrong, but is sort of the nature of the technology.

kingstnap•about 2 hours ago
There is little to no point reading the article as well. It's stripped of all alpha.

> task and environment feedback

> on-policy planning and learning

> feedback connects decisions to their consequences

These are deliberately the least informative phrases you could possibly use to describe what you have done, while still being in the realm of words that go over a generic investor who has no idea whats going on and may be dazzled by sciencey sounding language.

Cursor compose 2.5 article where they used and described on policy self distilation was actual alpha.

swagatkonchada•about 2 hours ago
It happens with open source software all the time, why would we expect any different with open source weights.
otterley•about 1 hour ago
Because the licenses that apply to software make no sense in the context of LLMs. With the latter, there is no source code to license.

The words of a license are what the license is.

reactordev•about 2 hours ago
Because we do. The GPL isn't a suggestion. If you can take open source code and make private software out of it then what are we all doing? No, license requirements and agreement are law for a reason.
bloggie•about 2 hours ago
Kimi K3 has its own license which is permissive, it isn't at all like GPL https://github.com/MoonshotAI/Kimi-K3/blob/main/LICENSE
srameshc•about 1 hour ago
> The problem: thinking models think too much

I see that with Opus 5, it started thinking like crazy in the last few days , I don't think my workflow is that complicated, still it gets into thinking mode and stays there

tomrod•about 2 hours ago
Well done, and great iteration.

The pareto frontier needs clearer distinction. Benchmarks miss half the story. What, if any, capability is lost by the token reduction (for example, was it like super awesome at Golang before and now kind of sucks? that kind of distinction).

drob518•about 2 hours ago
Unfortunately, it’s hard to make a chart of that.
Advertisement
riquito•about 1 hour ago
Aside. I find the "cost per task" charts both useful and uncanny. Is It better a model that takes me to 90% in 1 dollar or one that takes me to 95% in 2 dollars? Or a different model that too scores 90% in 1 dollar? How much will it cost me the last 10% or 5%? At the end of the day, cost to 100% is what matters and the half (90%) backed solution may require more to reach 100% (or not, who knows?)
swiftcoder•39 minutes ago
> Is It better a model that takes me to 90% in 1 dollar or one that takes me to 95% in 2 dollars?

It's pretty important to understand if your own work domain is one where the last 5% matters. In a lot of day-to-day software engineering tasks, it doesn't, and one can get crazy mileage out of the cheaper models. OTOH, if you are performing novel research, that last 5% may be worth whatever it costs...

blissofbeing•about 1 hour ago
Would be nice to include in fire pass.
erichocean•about 2 hours ago
Need this done for DeepSeek, ideally one of the Flash models.
drob518•about 2 hours ago
And GLM. Both Deepseek 4.1 Flash and GLM 5.3 Flash are quote verbose when thinking.
atemerev•about 2 hours ago
If you have the compute, I have the expertise.
tdhz77•about 2 hours ago
Does anybody know if this would be a good model for creative writing?
dbuxton•about 2 hours ago
Do they mean Opus 5.5 or Opus 5?
themgt•about 2 hours ago
The result? Ember-1 set a new Pareto frontier for Bedside Bench across both open and closed models including GPT-5.6 Sol, GPT-6 Astra, and Claude Opus 5 on cost/task.

"Pareto": 8 hits

"Opus 5.5": zero hits

wmf•about 2 hours ago
Obviously this research was done before 6.0 Sol and Opus 5.5 came out. Your point stands that the frontier moves quickly and small gains can be eclipsed quickly.
ls612•about 2 hours ago
On the smaller end, Quen 3.8, while being extraordinarily capable for a small local model, also suffers from extreme thinking. I wonder if the techniques described here generalize to other models too.
spijdar•about 2 hours ago
I suspect it might generalize to other large models, but I don't think Qwen3.8 27B is one of them. Kimi K3 is a 2.8 trillion parameter model, and I suspect that is playing a big role in being able to reduce the length of CoT without taking a hit in quality.

That's just vibes, though.

monkey_monkey•about 2 hours ago
I don't think the article mentions Pareto frontier enough.

Also, did I miss a memo? Suddenly every article on AI seems to be talking about the Pareto frontier - or have I just not been paying attention?

user43928•about 2 hours ago
Pareto frontier on some benchmark that I am hearing of for the first time.

Kimi K3 with less reasoning tokens isn't exactly exciting either, and particularly so if the license is less open than original Kimi K3.

AnodicElegy•about 2 hours ago
I guess they figure "best bang for your buck" comes off a little too colloquial.
DonsDiscountGas•about 2 hours ago
They want it to be the best at something. And it's obviously not the absolute smartest. So here we are.
logicallee•about 2 hours ago
This is really interesting. I think the Fireworks Serverless Training infrastructure they used to develop it is also unique and needed. Except if someone works at one of a handful of the largest labs, it is very difficult to set up or try any sort of training pipeline. The managed training infrastructure makes it available to more people.
nostrebored•about 2 hours ago
I can’t help but think it’s more expensive tinker.
esafak•about 2 hours ago
It looks like it would be similar to GLM 5.3 Flash, had they tested it...
Advertisement