DE version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
75% Positive
Analyzed from 3234 words in the discussion.
Trending Topics
#model#pro#deepseek#models#flash#don#more#opus#same#using

Discussion (111 Comments)Read Original on HackerNews
Tested this model, and gpt-5.6-terra-high.
Results: this one had few issues. terra: none.
These results are consistent with my past observations with the latest flash version as well. What benchmarks say, vs what I've been observing are different.
They are good till the project is simple... not anymore.
For this however, a comparatively much simpler task, tarra-high works fine.
for your kind of task, harness tools matter.
I get drastically different tool call failure rates using Claude SDK vs OpenCode using Qwen 3.6 models
LLMs make containers in a pretty workable format for me (still hand tweak the env variables for a sanity check).
How exactly does it struggle here and why does postgres need to be built? Were the needs beyond what you get in a base image?
And this was my gh issue: https://github.com/amalshaji/portr/issues/308
And below was my prompt:
""" give me single docker-compose file that i can run on my server to run current project... you can read README.md , and then, this relevant page: https://docs-custom-reverse-proxy.portr-docs.pages.dev/docs/... ... this was the result of me raising github issue: https://github.com/amalshaji/portr/issues/308 ... you can use gh cli to fetch the details and comments...
i already have a caddy server running on my vps... and i will create wildcard certificates myself using certbot.. the domain name will be helloportr.xyz ... also, ports up to 9019 are already taken...
ask me if anymore info is needed... """
You can try yourself and let me know of what you got.
For comparison I looked at Qwen's claimed benchmarks for Qwen3.8-max (https://qwen.ai/blog?id=qwen3.8). Assuming each published set of benchmarks is believable, it looks like v4 Pro 0813 is better on average but overall performance is comparable. Pro 0813 is much cheaper. If you don't need vision capabilities then you don't have much reason to use Qwen3.8-max.
- 43.6 on HLE (Presumably without tools). Pro 0813 is a little worse.
- 86.6 on Terminal Bench 2.1. Pro 0813 is better.
- 55.9 on NL2Repo. Pro 0813 is better.
- 27 on Agent's Last Exam. Pro 0813 is a little worse.
- 72.5 on Toolathon-Verified. Pro 0813 is better.
- 56.6 on DeepSWE 1.1. If the DeepSWE listed for Pro 0813 is the same version, then Pro is better.
- 27.3 on AutomationBench. If the AutomationBench (Public) listed for Pro 0813 is the same, then Pro is better.
I guess we do need to wait to see if the upcoming DS pricing increase is enough to change the value proposition. As it is now, they could double or triple prices and it still would be a better value to use DS. I bet they know that.
Given how I think DeepSeek operates... I think they just release it when they feel it's ready, and don't even seem that concerned with what other people are doing.
* GPT-5.6 Sol: 65.5
* Fable 5 (w/ fallback): 64.5
* Opus 5: 64.0
* DS-V4-Pro 0813: 62.5
* Kimi-K3: 62.3
* DS-V4-Flash 0731: 55.8
* GLM-5.2: 47.3
GLM ended up being far slower, and far more expensive, for approximately the same results. There was never a problem that GLM could solve that DS couldn't solve, faster, and significantly cheaper.
I strongly agree that you shouldn't pick a model based on benchmarks. But for me, I found GLM really underwhelming given its cost and speed.
DSv4 isn't as good as GPT or Claude or what have you, but it's fast, and pretty darned effective. I can run a 3-bit quant of DSv4 locally on my system with ~15 tokens per second, and for a local model it might be the most overall effective at coding. For what it is, it's extremely impressive.
> Mythos 5 reproduced 83.8% of targeted vulnerabilities on a single try, and produced at least one crash in 99.4% of tasks. This is comparable to Claude Mythos Preview, which reproduced 83.1% of targeted vulnerabilities and produced a crash in 97.1% of tasks. By contrast, Claude Opus 4.8 achieved a score of 78.1% (95.7% any crash).
So their quoted figure exactly matches the figure for Mythos Preview, although they don't state the provenance. It could also quite possibly be an independent measurement of Opus 5.
[1]: https://www-cdn.anthropic.com/57a52ea7d8f0e54e8a542e90826608...
Deepseek 4 pro: Worked for 12m 02s - cost $0.12 - has bug.
Grok 4.6: Worked for 3m 18s - cost $ 1.41 - no bug.
You are saying that the products made by thousands of people are to be shit on and hidden away from discussion because you don’t like a guy in charge? That the quality and performance of the product is second tier to collective-take culture war considerations, real or mostly make believe? That only the things made by “The Good Ones” are to be discussed because of righteousness? Is it because if Rocket Man Bad, but Rocket Man Products Good, that would cost you legitimacy in the first part?
And you assert that while daring to talk about irony?
Competitive with opus 4.8 but weaker than sol or fable. About 20x cheaper.
For DeepSeek V4 Pro the typical split is 750 in, 290 out, 82k cached.
Cost per request for V4 Pro: $0.000875 per request.
Equivalent Opus cost (w/o taking into account cache write costs): $0.052 per request.
[1] https://opencode.ai/docs/go/#usage-limits
I keep track of my token consumption even on subscription plans and my equiv. cost for my 5.6-Sol usage is around $4000-$8000 a month.
Flash makes a lot more initial mistakes, and then has to re-check stuff, and produces much more output compared to Pro. It often gets to the correct result eventually, but the output volume is often 5x more than for Pro, and the initial outputs are often wrong, with the first few saying something wrong (like there's a bug, or the code won't compile when it does), and then saying things like "Wait, let me re-check:", or "Actually, looking at it more carefully:" and then it thinks a bit more and eventually gets to the right answer.
pro plans, flash implements. I am super happy with how flash behaves like that.
I can't wait to try this new one.
But their privacy policy is unusually bad - they can train off your prompts and completions.
I really don’t care if they train off my prompts.
The prices on OpenRouter still look the same.
i'm doing opencode <-> openrouter <-> official deepseek api (i don't get the opencode hate, i like it)
how are you doing it?
am also using Kimi K3 via kimi-code
and also GLM 5.2 via ZCode
happy with all three, they're trailing frontier but i figure if i'm running GNU/Linux then i ought to favour open weights models with my €s -- reduced my usage of claude/gpt to the ~$20 tier just to keep abreast of claude_code/codex developments
When the company I work for was evaluating it, there were multiple rough points. Their terms and conditions allowed training on prompts, the default behavior was to route prompts to their servers for conversation summary/labeling. One of their lead maintainers is also super toxic on many issues.
Sorry this is all baseless with no links, I’m on my phone and locating those issues again isn’t something I have time for.
It’s a good tool I just don’t like the privacy policies nor maintainers attitudes.
edit: there are banner announcements saying v4 flash pricing will increase first then overall by an undetermined amount
My threat model is that anything I POST to DeepSeek I treat as public to the web, as much as a public GitHub repo is.
In 24-48 hours there will be other options I presume
> [Opus 5's output] is beyond the comprehension of virtually all engineers and developers
That would make it pretty bad? The key defining quality of good software, is clarity, and the ability to simplify a complex problem to the point of it seeming trivial.
> Math, science, and engineering are all contained in one model. We may be experts in one field. The model is an expert in everything that humans know.
The bar here should absolutely be to judge this against the expert level within each domain. I have time and time come across LLM output being woefully underwhelming in every single request where I am an expert. For all areas that I am not, it sure seems plausible. It is far more likely than not, that it is equally inadequate in the areas I lack the necessary knowledge to tell.
If the AI is being subpar in every field and category compared to an expert in said respective field, then, what a strange gauge of a tool's usefulness. Are we attributing higher value because a single model is "attempting to solve all knowledge and fields at the same time", why is that of any importance, or excuse?
We should not define "intelligence" as how effectively it can convince a non-expert of something being plausible. That sounds like the absolute worst tradeoff. You'd have to waste the experts time in filtering and refuting incorrect postulations that are cheep to generate. The perfect storm for bullshit asymmetry.
Opus 5 and Fable 5 in particular suffer from this issue at worse level than most models in the same class.
If it's 500x cheaper than US models for similar ballpark performance just because it's hosted in China, sure whatever. If it's name brand like Anthropic/OpenAI/Google, that's kinda fine too.
If it's neither, like merely 50% cheaper than latest OpenAI whatever, however massive loss that pricing may be incurring to its provider, it wpuld be considered not worth any attention.
Fully compatible with the well known Antrophic API.
You only have to replace the URL and your key.
It may not be likely but it's definitely possible enough to be something people worry about.
I'm not even sure what "EU AI safety rules" are. Can't people in the EU just use whatever they want?
For funded startups it mostly just doesn’t matter a ton unless you are passing on inference in your product at scale
I’ll try out the latest models, but mainly stick with Claude only because I’m most used to its quirks and how to work around them. I imagine this is part of these hyperscalers playbook.
I will say though, I miss Sol model at work. It with Codex was amazing at first-shot understanding. Claude i need to scope out where to look otherwise a large portion of my token budget is eaten up
As an American, I'd much rather have my data kept outside the country than here where companies and the government have a lot more leverage over me.