Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

64% Positive

Analyzed from 4989 words in the discussion.

Trending Topics

#openai#profit#more#non#nonprofit#money#don#agi#should#reason

Discussion (250 Comments)Read Original on HackerNews

YetAnotherNick•4 days ago
Why can't someone ask what happened in Ilya's mind. Firing Sam and then signing the solidarity letter of Sam to leave OpenAI if was fired. Other than that, all other information seems kind of just going over the surface.
krackers•3 days ago
>what happened in Ilya's mind

I thought Ronan Farrow's investigate essay answered that pretty satisfactorily? https://www.newyorker.com/magazine/2026/04/13/sam-altman-may...

wdr1•3 days ago
It's paywalled. Could you recap for us?
krackers•3 days ago
https://archive.is/c7YNw - it's worth a read, summarizing his writing would be a disservice
cma•3 days ago
Part of the counter was Microsoft was going to try and hire everyone individually, compensating for the lost stock appreciation, without the org itself, if they went through with maintaining the firing. I think that could have been much harder to pull off, but maybe they made them believe it was an inevitable outcome.
tasuki•4 days ago
Yes, that, please! I also never understood why the board resigned after ousting Sam...
tyre•4 days ago
Because they lost and crumbled. They were unbelievably outmatched by Sam (a world-class manipulator) and Satya (the money behind OpenAI and himself a political genius.)

They were outmaneuvered, panicked, and folded.

Did they have to? No. But in the moment they thought they were on the precipice of nuking a deca-billion dollar company, their life’s greatest work, and a generational company.

It’s hard to stand against what they did. Unsurprising they couldn’t.

YetAnotherNick•4 days ago
Then they should have made the position clear to the public, or at the very least have some communication with the employees. It's not hard to say that they were against Sam for some particular reason, if they are firing him. At least if the reason is good that might have given them some credibility.

And why did Ilya become Sam lover after 2 days?

paulddraper•3 days ago
> It’s hard to stand against what they did.

It’s still unclear at what happened, to make Sam unfit to be the CEO.

photochemsyn•4 days ago
Obviously OpenAI betrayed their stated mandate by going to the largely closed-source API-access business model, which is the one that Anthropic, Google, and xAI also adopted, i.e. the high-margin hosted model businesses, while DeepSeek, Alibaba/Qwen, Baidu/ERNIE, and Tencent/Hunyuan are breaking that model by releasing various open weight models.

I think the Chinese labs have a fundamentally different viewpoint: they’re building infrastructure, and looking at it more like how a US corporation might like having some of its employees making core contributions to compiler ecosystems like LLVM/clang and so on. The payoff is down the road, partially reputational, but also having a great compiler is good for everyone in the computational business world. The rentier-finance capitalist instead wants to privatize the compiler and extract rents for access.

The thing about infrastructure is this: you don’t get a direct financial return on investment in infrastructure (think roads, which make other economic activity possible) unless you have some ridiculously corrupt system controlled by rent-collectors (which is how the US electricity grid and fiber optic backbone works). That’s all the major US LLM providers are doing: trying to collect rents on systems that were built using the global human knowledge base as inputs.

At the very least OpenAI should be releasing their older models on a steady timetable. Sure it might reduce some revenue streams but it would be good for their reputation.

optimalsolver•4 days ago
>So many people were trying to sign the petition at once that it actually crashed Google Docs

I still wonder how much peer pressure was behind that. Like, what if you think Sam is a scumbag and you're glad he's gone, but people are waving this petition in your face. What would you do? It would be really bad for you if the emperor returned and you were one of the few who didn't sign it.

Also, going by this video, the first order of business for an AGI should be finding a cure for hair loss.

fragmede•4 days ago
Nioxin shampoo generally works.
cold_harbor•4 days ago
what's wild is they accidentally solved it — pretraining IS unsupervised learning at scale, RLHF IS reinforcement learning. they just didnt know the recipe yet
jmalicki•4 days ago
pretraining isn't unsupervised, it is self-supervised - meaning it is moderately more scale limited.
sigbottle•4 days ago
What would unsupervised mean, would unsupervised be something like alphago playing against itself trillions of times?

Whereas self-supervised, allows learning without explicit annotation of data ; but it doesn't matter if the models already trained on the entire Internet, and it's not like a game where it can come up with effectively new training data for itself?

jmalicki•4 days ago
Unsupervised is basically clustering. Alphago is RL - winning or losing a game is a form of supervision.

Unsupervised is something where there is no intrinsic reward signal. In pre training, predicting the next token and seeing that it matches is a reward signal, hence it is self supervised.

cold_harbor•4 days ago
fair point — OpenAI's original plan literally said "solve unsupervised learning". the self-supervised distinction wasnt really standard til after BERT/GPT popularized it
jmalicki•4 days ago
I think it's an extremely important distinction because self supervised learning has real inherent reward signals. Something like clustering does not.
throwaway_2494•4 days ago
I remember when computer magazines were aimed at programmers and had code listings in them.

Then there seemed to come a time when all they talked about was the IBM vs. Microsoft lawsuit. From then on they must have felt that they had discovered a formula, because all they ever yapped about after was insider baseball of computer companies.

I find this sort of corp. vs. corp. coverage boring, sort of like techie reality TV. Who will be voted out tonight, Debra, or Deborah...?

paradox460•4 days ago
I remember when wired changed editors. After Chris Anderson left it became "gq but we talk about iPhones"
cmrdporcupine•4 days ago
I dunno man, there are two "tech" industry worlds and the one you and I -- hacker types -- think of as "tech" is not what the rest of the world means. They mean the other one, which has almost nothing to do with the actual technology and instead everything to do with the absolutely apeshit amount of money, power, influence and intrigue that the technology enabled.

This was a very large apeshit $$ amount back in IBM vs Microsoft but the scale of it now in the era of e.g. OpenAI etc is beyond imagination.

There's a whole generation of people whose association with the engineering/technology side of things only happened because of their interest in the other side of things.

I too miss old Byte magazine days.

ethbr1•4 days ago
This happened when business types realized technology could be enormously profitable (~PC era).

Then inevitably, tech news turned into business news.

myst•4 days ago
What do you get if you drop a teaspoon of business into a barrel of X? A barrel of business.
avaer•3 days ago
What gets me is back in the day when I said I was into tech I got shat on for being a nerd. Now I get shit on for destroying the world. And because I don't care about whose company is dating who (I'd rather be coding), people call me out of touch with "tech".

I feel myself going insane when I think about it too much.

mattmaroon•3 days ago
I looked it up, MSFT’s market cap in 2005 was $278 billion and would be like $450 billion in today’s dollars.

OpenAI will IPO soon AI probably more like a trillion.

Crazy.

andai•3 days ago
Interesting. So, the actual concern now for the average person is ... which narcissist is steering the apocalypse? Yeah, that's slightly more engaging than RAM prices.
globalnode•3 days ago
Replying so I can save this comment :)
mark_l_watson•3 days ago
Pardon the almost 50 year old nostalgia, but I got so much out of manually typing in code from old BYTE Magazine and other articles.
wolvoleo•4 days ago
I don't think it would have killed openai. It would have fixed it.
outside1234•4 days ago
The winners get to write history.
moogly•4 days ago
So Anthropic and Google? I only hear "ChatGPT" used as an invective these days.
koolba•4 days ago
Especially when they pick which history be in the corpus for the next LLM.
H8crilA•4 days ago
As far as Brockman account of the past goes, there's also his personal diary which was made public as a part of that lawsuit by Musk. Includes for example the line: "Financially what will take me to $1B?". BTW, if you don't know, Musk lost it because he filed too late, lol.
nba456_•4 days ago
If his entire personal diary got exposed and that's the worst that's in it, good for him.
tcp_handshaker•4 days ago
What about stealing 12 million books of copyrighted human culture, at massive scale, and then enclosing the value created inside proprietary, investor-backed systems? Something wrong with that?

What happens if you go tomorrow, downtown San Francisco, and leave a bookstore with one book without paying?

   "Behind every great fortune there is a crime"
         - Honoré de Balzac
tasuki•4 days ago
> What about stealing 12 million books

Who's missing the books? 12 million books is a rather large warehouse!

I thought HN was in the "information wants to be free" camp...

ralph84•4 days ago
> enclosing the value created inside proprietary, investor-backed systems

What do you think copyright does. Human culture is owned by humanity, not Disney or the New York Times.

temp8830•4 days ago
Even though the founders of OpenAI are not exactly someone you'd root for, comparisons to theft are silly.

By that token it would be illegal to go into a library, read a book, and actually remember what was in it. Except in this case the reader is a robot.

LLMs are such a fundamentally different thing that existing laws don't really make sense. Wait! Put the pitchfork down! I know, I know, stealing is stealing, and OpenAI founders are slimy. But what about derivative works? Why is a human making a hip-hop track allowed to sample, and a robot is not? Again, LLMs are such a fundamentally different thing that existing laws don't really make sense.

It's actually surprising in retrospect that nobody did this sooner. Even back in the 80s books about computers would gush about how a computer has enough memory to store an entire library's worth of books. It's just that someone finally figured out how to put an index on it.

Where I agree: given that this is basically the sum of all humanity's knowledge, the company should have been a non-profit. It was a non-profit. And then greed won.

mannanj•3 days ago
Oh and by the way, their employee got murdered who was testified to speak at a hearing about copyright.

and that murderee's mom is publically resentful against and tweets anti-sam Altman content regularly. It tells me that founder Altman has clearly not demonstrated proper empathy, sympathy or repaired what should be an emotional easy case of delivering to the mom whatever she needs for her peace (or maybe he's actually guilty of complicit in crimes).

nl•3 days ago
Learning is not theft.
spudlyo•4 days ago
Won't somebody please think of the copyright holders!?
Kinrany•4 days ago
How did the diary end up in the court files in the first place?
layer8•4 days ago
OpenAI themselves submitted the diary as evidence back in October.
secondcoming•4 days ago
legal discovery process?
applfanboysbgon•4 days ago
I'm curious what you're writing in your diary that's worse than blatantly admitting to fraud of this scale. He publicly misled people about OpenAI's "mission" as a nonprofit, while seeking to enrich himself to the tune of $1 billion(!!!) dollars.

Also, his entire diary was not in fact made public. The attorneys only quoted the parts that were relevant to the case, which pertained to OpenAI's transition from non-profit.

siva7•4 days ago
How about wiping out an entire civilization? Not even necessary to hide this thought in your diary if you have enough power. I've seen today - in fact any day of this year - much worse things than his diary thoughts.
_zoltan_•4 days ago
Worse? There is nothing wrong with wanting 1B. Anybody who said they wouldn't want it is lying.
jesterson•4 days ago
I wouldn’t want. I have enough. Not everyone is wanting money.

But it is not the point. The point is, when you take high moral ground and talk about bug problems to help humanity, and then your own diary exposes you as avaricious simpleton, the whole high moral ground crumbles. And you expose yourself as another grifter.

That’s what happened to Brockman. Although smart people could see these qualities in altman, brockman etcetera way before that happened

avazhi•3 days ago
There’s nothing wrong or strange about aspiring to be a billionaire but writing about it in your diary like a hormonal teen girl reading fairy tales is a bad look.

It’s also difficult to take people seriously if they only care about money or, in Altman’s case, power. Single minded obsessiveness about these sorts of things tends to render people intellectually dishonest by definition.

root-parent•3 days ago
Do you understand the kind of self-absorbed asshole you have to be, to seriously write in your diary, what do I need to do, to have wealth equal to the GDP of the Solomon Islands or the Seychelles? :-)
nativeit•4 days ago
That level of personal wealth is inherently immoral and doesn’t *ever* happen without exploitation.
sumeno•4 days ago
I would be a billionaire for about 5 minutes because I'd spend 95% of it making the lives of others better and still have enough left over that neither me nor any of my immediate family ever has to work again instead of hoarding it like the monsters who end up actually having a billion dollars.
exfalso•4 days ago
Nonsense. What the hell would you do with 1B? Give it to charities maybe. Maybe set up an investment where dividends are paid to charity. Running out of ideas
rozap•4 days ago
Every billionaire is a policy failure. It's not a question of equity, the issue is that no one human should be that powerful. It's very obvious that its leading to the US's rather quick and colorful decline. A small cohort of very powerful people are moving elections and policy to enrich themselves, everyone else be damned.
thenthenthen•3 days ago
Tres Comas!
bix6•4 days ago
I just don’t understand why a non-profit was allowed to do this. Does this not set a precedent that non-profit doesn’t actually mean anything? You can just use a favorable structure until it’s time to enrich yourself.
granzymes•4 days ago
I think it would be helpful for you to clarify which part of the chain you found objectionable:

- in 2015, OpenAI was founded as a Delaware nonprofit

- in 2017, OpenAI discovered the scaling laws and realized they needed far more compute (and thus money) than they had initially anticipated

- that discovery precipitated a series of negotiations between the founders on how to restructure OpenAI to raise more money for compute, ultimately resulting in Musk’s departure when the other founders would not give him control

- in 2018, OpenAI attempted to dramatically increase its fundraising despite Elon ending his contributions, but raised only $50M of its $100M goal

- in 2019, OpenAI created a capped-profit subsidiary in order to attract funding from commercial entities

- the nonprofit hired an independent assessor to value its IP, and then transferred that IP to the for-profit for fair value (around $60 million in 2019)

- the OpenAI nonprofit received a right to 100x capped return on its IP investment, or $6B, once the for-profit began making a profit. The nonprofit also received the right to the residual profit after all future investors reached their caps

- in 2019, OpenAI’s capped-profit received $1B in investment from Microsoft. OpenAI later received $2B from Microsoft in 2021 and $10B in 2023 as compute scaling continued

- Microsoft received a cap of 20x on its $1B investment, and 6x on its $2B and $10B investments, for a total of $92B target redemption

- in 2025, OpenAI’s for-profit entity recapitalized from a capped-profit entity with residuals flowing to the nonprofit to a traditional public benefit corporation with traditional equity

- in exchange for the residual (and 100x profit cap on the original $60M transfer) the nonprofit received a 26% equity stake in the for-profit. That stake is currently valued at around $200B

All of the above is from the record in Musk v. Altman, thanks to which we now have all the details. The upshot for the nonprofit is that it transferred IP worth around $60M in 2019 for rights to $6B in future profit, and then ended up with $200B in equity after the recapitalization. I see a lot of people in this thread assuming that the nonprofit no longer exists, which is not true.

dooglius•4 days ago
The objectional part would be:

- in 2019, OpenAI created a capped-profit subsidiary in order to attract funding from commercial entities

Particularly if it creates a conflict of interest for anyone making decisions on behalf of the nonprofit

granzymes•4 days ago
I'm curious why you think that creating a for-profit subsidiary is objectionable, since it is extremely common for large nonprofits. A good example for this forum would be Mozilla, but many more were mentioned during the trial.

Also curious what conflicts of interest you have in mind.

az226•3 days ago
100% disagree.

- in 2025, OpenAI’s for-profit entity recapitalized from a capped-profit entity with residuals flowing to the nonprofit to a traditional public benefit corporation with traditional equity

This is the egregious part. Before full for profit conversion it was worth $300B. Then after $850B.

A true fiduciary would set an auction and that would set the price for for profit valuation. And then all existing investors would keep the value of their positions, but would be diluted because capped profit is worth much less than unlimited profit and residuals.

But, they sold it to themselves for a bargain basement price. The nonprofit lost out on $300B or so. Maybe more.

It was not an arm’s length transaction. It was self-dealing.

93po•4 days ago
worse than that is the $60 million sale price, which was comically and absurdly low. Elon himself said he was willing to buy it for significantly more than that and the fact that it wasn't able to go to the highest bidder just shows that it was bullshit
55555•3 days ago
Thanks for listing all this out. I took issue with it in theory, but now that I see it written out, I don't find any of it objectionable. People act we though the nonprofit doesn't exist anymore.
beering•4 days ago
The OpenAI non-profit is now one of the biggest non-profits in dollar-denominated assets. If the goal was to make the non-profit really big and well-funded then that seems on track. But not clear to me what it would do to advance its mission.
senordevnyc•3 days ago
They seem to think they need trillions in investment to reach AGI. Putting aside whether reaching AGI is feasible, it seems pretty clear how this move enables them to advance their mission, at least in their eyes.
bix6•4 days ago
The whole process has been a circus but I found the AG waiver rather frustrating. Nothing like negotiating with a charity to get an IOU that it’ll be charitable. https://oag.ca.gov/news/press-releases/attorney-general-bont...
senordevnyc•3 days ago
This is super valuable, thank you so much. It makes it clear just how misinformed 99% of HN seems to be when ranting about how Altman perpetrated the greatest theft in history or some such bullshit (conveniently always failing to mention that he holds NO equity in OpenAI, despite how easy it would have been for him to do so).

Appreciated!

overgard•3 days ago
I find it unsettling that a company who wants to eradicate the middle class's ability to make a living, possibly bring about the singularity (I don't think they'll accomplish it, but they want to), and are actively creating one of the most massive bubbles we've ever seen is somehow a "public benefit" company. Absolutely nothing they're doing is to the public's benefit.
bwhiting2356•3 days ago
How can something be both a bubble and also eradicate the middle class's ability to make a living? There are reasonable people making the case for both of these things, that investment in AI will fall flat and that AI will be too powerful. Coalition forces are pushing them together into an anti-AI camp, but there's a contradiction. Is it too powerful or not powerful enough?
pluc•4 days ago
There's a lot of things these days that you can't do that are being done.
stingraycharles•4 days ago
And this is by far one of the more innocent, unfortunately.
tim333•4 days ago
Non profits have always been able to have for profit subsidiaries, owned by the non profit.
wrsh07•4 days ago
IKEA is a famous example, although they sequenced things in a way many commenters here would probably be fine with

https://en.wikipedia.org/wiki/IKEA_Foundation

throwup238•4 days ago
Other examples include Mozilla Foundation and Mozilla Corporation, the latter of which pays taxes on the money it gets from Google for default search engine placement, and the Smithsonian gift shop, which is a common pattern for museums all over the country. Novo Nordisk is another example, maker of Ozempic, and it’s the richest foundation in the world because it spun off a for-profit that then went public.

IRS requires nonprofits to pay taxes on “unrelated business income” and spinning it off to a for-profit subsidiary is the least risky way of managing that revenue.

siliconc0w•4 days ago
Most startups don't actually make profits and nonprofits can't give equity so it's not really a favorable structure.
Gud•4 days ago
It’s a favourable structure in many cases.

Not everything is a business.

OpenAI wasn’t, until it was.

mattmaroon•4 days ago
Most nonprofits don’t have a mission that would benefit from a transition or a trillion dollar product to sell. There would be no real way to profit they wanted to.
rvz•4 days ago
This case was the first of its kind and it was never tested if OpenAI breached their charitable mission and the case was dismissed due to the statute of limitations.

Other than researchers, nobody from big tech would ever see themselves wanting to work at a charity / non-profit. The moment the VCs came into the picture then all the grifters poured in and AGI meant IPO.

> You can just use a favorable structure until it’s time to enrich yourself.

Maybe that diary was made out of teflon.

p1esk•4 days ago
Other than researchers

Are you saying researchers are less interested in quality of life than other people? If this was true, frontier labs wouldn’t need to offer 7 digit compensation packages to their researchers.

pessimizer•4 days ago
Nonprofit doesn't mean anything, since people can just route the profits into salaries. It's just another legacy regulation that may have once once had a societally-constructive purpose that wealthy people just use as one of the array of financial tools to help implement their latest scams. IMO, here are no legitimate nonprofits.

Western countries have been utterly strangled by nonprofits. Governments fund them with tax money in order to lobby themselves for legislation that financially benefits individuals in government and their donors. Obama even expanded the rules in the US to allow the government to unconstitutionally fund religious groups to accomplish functions that belong in government.

They should all be either reformed so that their internal bylaws and compensation are strictly regulated or probably preferably, they should simply be destroyed. If you only pay taxes on your profits (and we get rid of legal vehicles to hide profits) and your employees are obligated to pay taxes on their incomes, there's no need for a nonprofit status. If nonprofits want to engage in business (religions included), let them pay taxes. If they engage in charity, they won't have anything to tax.

gottorf•4 days ago
> Western countries have been utterly strangled by nonprofits

To expand, there are two major problems with nonprofits in Western nations these days:

1. Governments use them as a way to do things that they themselves are not allowed to do ("it's private charities that do this!", ignoring the fact that the charities get >90% of their revenue from government grants)

2. Like you mentioned, the government grants to nonprofit back to politicians' campaign funds pipeline. Utterly egregious.

> Obama even expanded the rules in the US to allow the government to unconstitutionally fund religious groups to accomplish functions that belong in government

I wasn't aware of this being a big concern; more the other way around, like in my point 1.

bickfordb•4 days ago
One reform I would make would be to limit tax breaks to actual charitable activity within an organization, instead of a blanket tax break to the whole organization. For example if a Church/Hospital runs a soup kitchen and homeless shelter, those resources should be tax free, but maybe the rest of their activities shouldn't be by default.

Another reform I would make would be around independent governance and removing donor control of charities to reduce the number of sham Rich Guy foundations.

tyre•4 days ago
> Another reform I would make would be around independent governance and removing donor control of charities to reduce the number of sham Rich Guy foundations.

This one is tough. I mean, look at the Clinton Foundation. One reason to believe that $1 there is more effective than somewhere else is _because_ the Clinton’s are closely involved.

Of course, you get massive donations there because people want to influence the Clintons and/or _through_ the Clintons. Would those people / states donate otherwise? Would they donate to _better_ organizations? Maybe! Maybe not!

* Also I’m not saying the Clinton Foundation is more/less effective. You’re almost certainly better donating to GiveDirectly, but it’s not on its face ridiculous to think that they, specifically, could effect a _different_ type of change than others would have access to/influence over.

outside1234•4 days ago
It should not surprise you to learn that Greg Brockman is a Trumper and major donor.

It should also not surprise you that the Epstein files have not been released.

Everything is possible and not possible in a corrupted system.

NDlurker•4 days ago
He's from North Dakota, just like Doug Burgum. Lot of Trump cultists in ND
batu1509•4 days ago
building products on top of their api makes these drama weekends terrifying. really makes you realize how fragile your whole stack is when a board decides to act up.
jeffrallen•4 days ago
Or when sociopaths are in charge, and the board tries to fix that, but other sociopaths work together to overrule the board. (And wtf is that anyway, overriding the board? Why do we even have boards of directors if rich, powerful assholes can just do whatever they want?)
sumedh•4 days ago
> and the board tries to fix that

The board didnt have the maturity to fix that.

bmitc•4 days ago
So firing a grifter means it would kill the company? Doesn't that mean the company is grifting? If no one else can possibly lead the supposedly the most important company, with billions/trillions (?) of so called value, do you have a good company and product?

Or do I forget that this guy sleeps with an Ayn Rand doll tucked under his arms?

okr•4 days ago
ChatGPT or CoPilot were awesome products at the time. I do not use them anymore these days. But to me it felt never like i was abused. And Investment into companies is what it is, a risk. But the results remain forever, whoever wins.
zemvpferreira•4 days ago
Not a fan of Altman but the devil you know is a powerful argument. If you believe a CEO/Founder to be a grifter-position at its core (fake it till you make it etc etc), retaining the best grifter you can find is the optimal play.
jonstewart•4 days ago
Point of order: Anthropic is the most important AI company now.
CuriouslyC•4 days ago
Anthropic is the most hyped AI company now. Their models aren't the best, but their marketing sure is.
sumedh•4 days ago
> Their models aren't the best

the market has spoken, for coding they are the best.

CuriouslyC•3 days ago
The market has spoken: McDonald's makes the best hamburgers.
7thpower•3 days ago
Can you please define what “best” is and why the market is a measure for it.
tim333•4 days ago
People discount Google/Deepmind but a lot of the original research was done there including inventing transformers which form the basis of the other AI companies.
tyre•4 days ago
If anything, the amount of original and foundational research at Google is a black mark against their position now. They blew a hell of a lead.

I’m willing to discount what they did almost a decade ago (“Attention is All You Need” was 2017) in an industry that moves this quickly. The execution of an Anthropic matters more now.

borski•3 days ago
Short term, that’s definitely true. Long term, I’m not so sure.
outside1234•4 days ago
It really does feel like OpenAI has lost their leadership. I haven’t used a model of theirs, let alone an app, in months.
Advertisement
booleandilemma•4 days ago
If only we should have been so lucky.
mikkkee•4 days ago
not sure why but this episode feels v boring perhaps because he didn't share anything unexpected / unknown
tim333•4 days ago
I found it more interesting than I thought because I thought it'd all be stuff I knew but a lot was new to me.
quantum_state•4 days ago
It’s a matter of fact that OpenAI betrayed its origin.
wrsh07•4 days ago
I think of it more as a parable about how effective 'tying yourself to the mast' actually is

The founders of OpenAI naively^ thought "this will make sure that we don't have too much power if we succeed"

But it didn't work. What lesson should we learn?^^

^ please grant this for the sake of argument

^^ I have other models that I prefer to explain what happened, but I think this one is the most interesting

pjmlp•4 days ago
Unfortunately they survived, not going to spend time with this.

From my point of view they are yet another big tech bros company.

jorisw•3 days ago
About as empty a comment as ever
pjmlp•3 days ago
Nah, a comment about a point of view, naturally doesn't land with AI bros.
embedding-shape•4 days ago
Not feeling like 1 hour of my Sunday is worth listening to this, do anyone have the non-clickbait answers to the two "previews" mentioned in the description?

> Greg explains how the original Napa offsite produced the three-step technical plan OpenAI has followed for a decade and the real reason OpenAI had to abandon its pure nonprofit structure

What was the technical plan and what was the "real reason" they couldn't achieve their original goals?

applfanboysbgon•4 days ago
> What was the technical plan

"1. Solve reinforcement learning

2. Solve unsupervised learning

3. Gradually learn more complicated 'things'"

That three point list is verbatim the extent of the technical plan mentioned.

> what was the "real reason" they couldn't achieve their original goals?

Paraphrasing, "we needed more money for compute and didn't think we could get enough as a non-profit". Brockman's diary might be a stronger indicator of the real real reason, though.

armchairhacker•4 days ago
What was the real real reason?

I imagine if they stayed nonprofit, they would’ve survived, but not convinced investors to give them enough $$$ and datacenters to stay the most popular (above Google).

Lerc•4 days ago
If they stayed small and 100% non-profit, would the influence or value of the non profit be more, or less, than it is today?

I think the non-profit has around 25% ownership of something that is around a trillion dollars of on-paper money.

I guess we will see what things are still worth when the crazy days come to an end.

greatgib•4 days ago
I can easily guess also that at the beginning they were more thinking like a research project that they could create something but would like quantum computing today, not really of real world used.

And one things started to become real, they realized the financing potential of the thing, that they were seated on a gold mine and would be stupid of them to create that and not profit much more of it.

wahnfrieden•4 days ago
To get rich of course
coalstartprob•4 days ago
the real real reason being gdb wanting to be a billionaire ;)
cma•4 days ago
Unsupervised
jstummbillig•4 days ago
bblb•4 days ago
https://www.youtube.com/watch?v=6JoUcQ1qmAc

    00:00:00 Introduction
    00:00:49 Meeting Sam Altman and Starting OpenAI
    00:02:40 Building the Founding Team
    00:04:25 DeepMind's Lead Over OpenAI
    00:04:54 The Change from a Pure Non-Profit
    00:06:05 Breakthrough Moments at OpenAI
    00:08:22 What Dota 2 Meant for OpenAI
    00:10:04 Reasoning Versus Prediction
    00:11:59 Tensions Grow at OpenAI
    00:15:44 Sam Altman's Firing
    00:17:49 Greg Quits OpenAI
    00:19:56 Sam Explores Deal with Microsoft's Satya
    00:20:28 OpenAI Employees Sign Petition for Altman's Return
    00:23:43 Ilya Sutskever Leaves OpenAI
    00:24:59 Lessons Learned in Leadership after Sam Ousting
    00:28:22 The Thing Ilya Said that Greg Can't Forget
    00:32:22 Is AI Going Parabolic?
    00:33:24 How Much of OpenAI's Code is Written by AI?
    00:36:21 Are AI Chatbots Just Telling Us What We Want to Hear?
    00:38:06 The Global AI Race to Reach AGI
    00:38:40 What Happens if US Doesn't Reach AGI First?
    00:39:49 Are Competing Countries Stealing AI Advancements from U.S?
    00:40:38 Why ChatGPT No Longer Shows Reasoning
    00:41:47 The Finite Constraints of Compute
    00:43:38 On Investing Early in Data Centers
    00:46:31 The Future of Data Center Specialization
    00:47:52 How OpenAI Will Decide Whose Queries to Serve
    00:49:08 OpenAI on Consumer vs Enterprise Models
    00:53:05 Data Centers in Space?
    01:00:56 What Should AI Regulation Look Like?
    01:04:33 The Future of AI-Powered Entrepreneurship
    01:04:44 AI and Job Loss
    01:07:15 The Skills Young People Should Invest In
    01:11:30 What Does Success Look Like For You?
tcp_handshaker•4 days ago
>> What was the technical plan and what was the "real reason" they couldn't achieve their original goals?

Because they were still downloading from Anna's Archive and the lawyers were in panic?

dave1010uk•4 days ago
1. Solve reinforcement learning.

2. solve unsupervised learning.

3. gradually tackle more complicated things.

> what was the "real reason" they couldn't achieve their original goals?

I assume this is referring to why they gave up being a non-profit. The answer is that they needed more money.

embedding-shape•4 days ago
Huh, I guess ML people weren't aware of "divide and conquer" that has been successfully employed in software engineering since basically forever?

> I assume this is referring to why they gave up being a non-profit. The answer is that they needed more money.

Ugh, that was more boring than even I expected, thanks a lot for saving me the time though, seems avoiding watching the full thing was worth it.

adastra22•4 days ago
Not that they wanted more money personally, but that they needed more money for compute.
arvid-lind•4 days ago
> The answer is that they needed more money.

isn't it still an odd choice for a nonprofit? it's hard to imagine a world without OpenAI and ChatGPT now, but at some point they decided being the best is most important. and presumably most profitable, since why just need a little more money?

mycall•4 days ago
Don't all nonprofits need more money to improve their sustainment?
gizajob•4 days ago
Trivial to imagine everyone switching to Anthropic or Google or on-device LLMs.
siva7•4 days ago
> Not feeling like 1 hour of my Sunday is worth listening to this, do anyone have the non-clickbait answers to the two "previews" mentioned in the description?

I know HN is built around mostly not reading the articles linked but how about you click on the link and surprise, there is already exactly another link providing what you're asking for.

embedding-shape•4 days ago
You mean the transcript that is behind a account/paywall? Or is there some other link I'm missing?
monkey_monkey•4 days ago
Apparently we're all expected to somehow know that "Granola notes" is a summary of the conversation.
siva7•4 days ago
Yes, you're missing the link at the end of the article for free.
PunchTornado•4 days ago
isn't this the friend of scam altman? who cares of what he has to say?
stuaxo•4 days ago
Thankful for the mention of "AGI" in the first lines as I can bail out from reading the rest.

Whatever AGI is, it "AGI" is not glueing a load of text prediction machines together.

_heimdall•4 days ago
> Whatever AGI is, it "AGI" is not glueing a load of text prediction machines together.

K don't think it would be that simple either, but for now we simply don't know.

I would like to think that what I consider my intelligence will always be distinguishable from a cleverly built harness wrapped around text prediction, but I can't say for sure that's guaranteed.

grey-area•4 days ago
Yes we do know. We’ve fully explored the possibilities of LLMs and they are nowhere.

The latest efforts like agents are clearly showing the limitations and are nowhere near AGI.

We’ve now reached the buzzwords and bullshit stage of the bubble where they cast around for problems shaped like the solution.

_heimdall•4 days ago
Oh this bubble started in the buzzword and bullshit stage, no argument there. I'm just not sure how you can be so certain LLMs will have no place if a system we'd consider AGI, most inventions do require a long list of failures and tweaks before it finally works.
tim333•4 days ago
I'm not sure people are saying AGI is glueing text machines.
dboreham•4 days ago
How do you know that?
_wire_•4 days ago
Shannon Got AI This Far. Kolmogorov Shows Where It Stops - Vishal Misra

https://medium.com/@vishalmisra/shannon-got-ai-this-far-kolm...

This article explains what's missing in terms of two kinds of complexity that oppose: Shannon complexity vs. Kolmogorov complexity.

It introduces the opposition by an example of driving the value of pi as decimal number, which has no pattern and high complexity, and a formula for deriving pi that does have a pattern with low complexity, then observing that mind can work from the patternless high-complexity back to the patterned low-complexity without prior examples, while AI can't.

LLMs encode and retrieve patterns in the training data, and doing so can connect data to the terminology of known principle, but mind can observe inconsistencies in data and to reason from first principles to resolve the inconsistency.

The distinction between these two modes can seem blurry as AI can traverse the patterns of the known in ways that are extraordinarily revealing, but it's not structured to reason about the unknown.

Inference is not sufficient for reason.

For example, a conventional algorithm can search for patterns in text at a scale many orders of magnitude beyond a mind's capacity, and this can be very revealing, but to do so this algorithm need not read the text with comprehension.

Regarding the question: can genAI be enhanced to reason? The answer is assumed to be "no", due to the categorical opposition of the two kinds of complexity and the lack of understanding of structures within genAI to handle the reasoning.

Read the article, which includes other examples including a jump from Newtonian to Einstein physics in the history of astronomy, and a noodling on how to talk about the edge of the unknowable in AI.

dannersy•4 days ago
Because then we already have it, and if we do, it is pretty underwhelming.
kaashif•3 days ago
So maybe we do have it, and it is underwhelming? Or it's not underwhelming and we just got used to it.

Using that as an argument to say we don't have AGI doesn't really make sense.

Regardless of whether we do or don't have AGI, until I actually see the economy-ending job losses, I won't believe it.

ImPostingOnHN•4 days ago
so are most humans
jordemort•4 days ago
too bad, eh
throw6999•4 days ago
Sky net from future protected itself.
portly•3 days ago
Does everyone at OpenAI vocal fry like that?
Advertisement
greazy•3 days ago
Its really telling the example of personal AI/AGI given was booking tickets to a show.
intev•4 days ago
If anyone else doesn't want to listen to the whole thing: https://apecast.app/podcast/the-knowledge-project/episode/op...