Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
80% Positive
Analyzed from 754 words in the discussion.
Trending Topics
#nvidia#openai#happen#companies#model#fact#more#anthropic#still#better
Discussion Sentiment
Analyzed from 754 words in the discussion.
Trending Topics
Discussion (27 Comments)Read Original on HackerNews
There's a release from DoE about it: https://www.energy.gov/articles/fact-sheet-department-energy...
That's a horrible amount of gas energy generation.
https://www.datacenterdynamics.com/en/news/openai-in-talks-t... has more details. The whole campus build could be as much as $500B.
Would that be the most expensive single thing ever built? The ISS cost around $150B and is commonly said to be the most expensive single item, but that does include running costs.
If shit hits the fan, the companies collapse, then Nvidia gets their money from the investors anyways.
If Nvidia sells hardware for $100B with 75% cross margin, and provides $50 billion in backstop for that same hardware, it would be still be nicely profitable deal ($25B) if the backstop capacity would be a total write-off recovering $0. Reselling that capacity in some large discount below already low backstop price would increase the profits.
It's all those pension funds, sovereign wealth funds and Softbank getting into that $500 billion deal that will be hurt.
Others have played it fairly smart in terms of insulating potential issues.
Basically what i am saying is maybe there is a better buyer than openai.
Even if it did, it still doesn't make much economic sense running a model locally vs on a datacentre.
For example, I managed to just about squeeze a Q2 quant of Qwen 3.7 27b on my 9070XT. I get around 60tps decode (slightly faster prefill). _but_ it uses 300W of power to do so. At UK electricity rates of 30c/kWh this works out at something like 42c/MTok. I can get far far better models on openrouter cheaper than that, plus I'm not horrendously constrained on context length.
Like even if you run it in a datacenter in this scenario, you could do it on a cheap GPU instance in Azure, you still wouldnt need OpenAI or Anthropic specific clouds.
>uses 300W of power to do so.
There are plenty of people with phat electricity pipes in their on prem server rooms that have been vacated for cloud. Companies who want the benefits of AI but dont want the risk of sending their data to foreign API endpoints.
If it does happen then NVidia will sell a lot of 5070s though!