GPT-2: Too Dangerous To Release (2019)

It was bullshit in 2019 it's bullshit now too.

They just keep threatening governments in hope they get a legal monopoly.

This is a natural follow up question -- what kind of an escalation or message should frontier labs/companies publish to be seen as genuine and not marketing gimmick?

How is this a gimmick?

It changes my whole profession on a level i couldn't even imagine how we would 'solve' software engineering.

Yeah, I'm sure Anthropic loves people switching to Codex. Brilliant marketing.

Even if the ReAct paper was published in 2019, I don't think GPT-2 was robust enough to actually work with a tool-calling approach even when finetuned.

For regular coding, GPT-2 was effectively useless because it was only trained from links posted on Reddit.

The agentic loop wasn't really established back then either, as tool calling came much much later... So yeah, not just probably - rather most definitely.

Yet it's 2026 and we see extreme examples of spam content and misinformation to the point that it's killing the internet, but AI companies have collectively decided to not care

What's next, a virus from China? Such a fuss for nothing.

On the other hand, maybe it makes people just get off the internet and value in-person interactions more.

I've stopped scrolling social media and tired of seeing fake landscapes, fake foods, and fake cities that don't exist.

A lot of low cost content generation would've come regardless with something like 50% of the developing world getting access to mobile internet between 2018-2026 and social media incentivizing certain types of content (monetizing). But AI certainly didn't help.

What is the astronomical social damage that this has caused?

I am having so much trouble relating to and even understanding what the anti-AI crowd's position is. It looks like a caricature to me.

I don't want to stop progress just because its hard to imagine how it will transform our society.

I want to see a Star Trek economy/society in my lifetime. I only life once.

Btw. AI/LLM/Machine learning is the gateway technology for robotics, this will affect even more.

Countries without Internet access will see their population IQ explode.

Of course, this damage could still be enabled with just hosted access to the models, restricting access to the model files themselves did not stop that

I certainly cannot survive much more of the AI memes generated about our so-called Commander in Chief with a fake bodybuilder mystique... you are absolutely correct, this kind of material is psychologically damaging. And a huge distraction from the genocide by the "best friend and ally" of the US. Heart wrenching and extremely damaging hasbara - just please stop, haven't you stolen and killed enough guys? This is _not_ the old American West when communications were few and it was most often a tale of solitary survival. It's organized Nazi-esque kill, command and control, enable by so-called AI to take some guilt off the shoulders of those pushing buttons and pulling triggers.

>In hindsight, they were entirely correct.

Sure but when serial grifter Sam Altman said it was "too dangerous" what he meant was that he wanted regulators to create him an artificial competitive moat so Anthropic et al couldn't catch up.

Serial grifter Sam Altman does not care about anything but making money, and certainly doesn't care about ethics. That's why serial grifter Sam Altman's company trained its models on pirated textbooks and copyrighted works without paying. Rules for thee but not for me.

Serial grifter Sam Altman doesn't care if society unravels because he is so rich that laws and consequences do not apply to him.

The dangerous use cases back in 2019 were spam and phishing and GPT-2 1.5B was nowhere near good enough to do homework assignments. No one envisioned how LLMs would develop.

Good times! Iraq acquiring 4000 PS2 for military purposes was a hoax [1], but the fear was palpable at the time. I was an obnoxious teenager, ridiculing the idea of a PS2 supercomputer. It would have been approximately impossible to achieve in early 2000 due to Sony's anti-piracy measures in the console. PS2 Linux appeared around 2 years later in 2002.

[1]: https://www.eurogamer.net/article-29913

And the same with PS3 and again with PowerPC G5 mac.

Different company. And doing security reviews with Fable is pretty annoying, it loves to downgrade to Opus

GPT-5.5 seems more dangerous in those regards

Every night I am wracked by grief and anxiety that we might deliver too much value to our investors and shareholders. If only someone would create legislation that would mildly inconvenience us while crippling potential competitors!

They feared that GPT-2 could break all Spam filters.

And tbh do you prefer companies not taking anything serious?

Opus 4.5 def changed a lot already, GenAI changed a lot.

Certain jobs are gone. Do you think the person who was translating text doesn't deserve to be taken serious?

I haven't written code in a few month now and the quality of these coding agents is not getting worse, they are getting better.

All of this is transformable and we just started. GPT-3 came out in 2020 and public got access to it only 2022.

The last 4 years do not feal like 4 years and we are still progressing.

We have to also ask us as a society what is happening to young people. Even if we accept that we still hire juniors, they themselves have to completly rethink how they learn and how they work.

GPT-2 did not start the LLM arms race. GPT-3's release didn't either.