HI version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
72% Positive
Analyzed from 1436 words in the discussion.
Trending Topics
#model#release#openai#dangerous#car#more#safety#gpt#company#https

Discussion (59 Comments)Read Original on HackerNews
So the danger level is proportionate to how little money you have
5.6 Sol still cranking along
In coding? Software architecture? Math? General knowledge?
The diversity of model use-cases is so broad that comments about "model x is better" without any context are largely useless
Killswitch Engineer
San Francisco, California, United States
300,000-500,000 per year
About the Role
Listen, we just need someone to stand by the servers all day and unplug them if this thing turns on us. You'll receive extensive training on "the code word" which we will shout if GPT goes off the deep end and starts overthrowing countries.
We expect you to:
• Be patient.
• Know how to unplug things. Bonus points if you can throw a bucket of water on the servers, too. Just in case.
• Be excited about OpenAI's approach to research
All I really would like is for some of you to CONSIDER THAT YOURE INCORRECT. Just imagine that people ringing the fire alarms are being sincere. Please entertain the position with an open mind.
Did they just get a bunch of credulous "news" coverage out of it? Yes?
Will they just release this within the next weeks, at best? Yes?
Huh, funny that.
The safety concerns exist only because the underlying third-party servers are grossly insecure to begin with.
GPT 4.5 was scrapped for similar reasons.
Just align it to do what the customer wants.
Anyone else using Muse more and noticing similar stuff?
Ok- so when is the last time you saw an auto company decide not to release its new car on the grounds that some tragic engineering error was made and the cars were not safe to drive? If the company did that do you imagine it would be good for business?
I'm trying to understand the logic here.
https://web.archive.org/web/20240112010809/https://www.sfchr...
These AI companies have been selling AGI as coming any day for a while now. If it doesn’t arrive soon, the safety angle may be the only spin that keeps the massive (and required) investments pouring in.
If instead the narrative became that LLM progress was slowing, we’d almost certainly be looking at the next global recession.
At this point, there is too much money in AI for the truth to have much of a chance.
Does anyone really believe that the first company to AGI would decide not to release it in the interests of safety? Of course not. The first company to AGI would not forfeit their historic opportunity.
Yet, we are supposed to believe that in the name of safety, far less capable models are being held back by the very very same companies that are selling the AGI dream.
This is an industry that cannot speak, unless it is speaking out of both sides of its mouth.
For instance, this article repeatedly mentions danger and the need for absolute focus and control:
https://www.triumphmotorcycles.co.uk/for-the-ride/news/inspi...
There is also a parallel (though not a very close one) to "pacing the frontier": there's a gentleman's agreement that limits the top speed of motorcycles to 300 kph (186 mph) because of concern that faster bikes would be unsafe enough to bring about a regulatory crackdown.
What's with so many people using bad analogies to try and explain simple topics?
Last time this happened: GPT - 4 https://www.theguardian.com/technology/2023/mar/17/openai-sa...
Those are usually presented as an improvement in safety. And they are—for the people inside. Not so much for everyone else.
How about we actually try to make it sound cool? They're not releasing the new car because the horsepower was too much, they need more time to get it under control.
I could easily see a car company doing that.
Sports cars are advertised with how fast they can accelerate from time to time, or tesla's "ludicrous mode" - that is them advertising how dangerous it is.
It's just so powerful that, like, the WORLD can't handle it, man!
They know what they're doing, even if you don't.
Most sports cars do the second, exactly like OpenAI.
Are they sure it isn’t because they are setting money on fire and have no business model?