ZH version is available. Content is displayed in original English for accuracy.
Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
49% Positive
Analyzed from 6719 words in the discussion.
Trending Topics
#found#don#more#sony#linux#exploit#llms#using#bug#lot
Discussion (186 Comments)Read Original on HackerNews
Same thing did happen to many work places. People at all levels proxy questions through LLMs and don't even bother to read/trim/edit the response.
Funny, how suddenly a tight, 1-2 sentence response on point is a sign of skill.
He got fired quite quickly after his boss realized it was all bullshit.
Wasn't it always?
A lot of people get this idea that "more verbosity = better" instead of optimizing for conciseness and information-density. I largely blame minimum word-count essays from school assignments.
It’s easy to send a pithy response that suggests experience and understanding without having either. Think of a middle manager spouting pithy buzzword laden cliches confidently in response to every request, then transferring the real problem to the grumbling employees who have to solve the actual hard parts of the problem which lie in the nuance.
Communicating well has always been a sign of skill. Talking to most devs was like pulling teeth even before LLMs.
https://github.com/JuliusBrussee/caveman
The experience in these spaces is largely the same. LLMs can be used there, too, but when the experts are using them with experience to back it up the results are a lot better.
The people who are really struggling in my few hobby groups (not PS5) are those who enjoyed some social status from their knowledge. They were heros and people sought them out and revered their work in 2023. LLMs came along and partially leveled the playing field. When a determined kid with a Deepseek subscription can produce a sloppy version of what took you years to find, that sense of being a heroic figure at the next level is gone.
I think this reveals another wrinkle, which is that the status hierarchy wasn’t that solid or worthwhile anyway. Outside of a few vocal people trying to enforce the status hierarchy, most people don’t care who releases their jailbreak or PS5 exploit. They just want it. Whoever gets it to them first becomes the new king.
This PS5 incident has some strange element where supposedly keeping the reveal secret for 2 more weeks would have changed something with the GTA6 release. There were also 3 people who found the same exploit independent and some large amount of money on the line for the first of them to report it. The person who reported it signed off to spend time with his dying mother, so can’t really fault them for doing the thing they earned according to the rules of the program.
Well it's that GTA 6 comes out in mid-November, so he wanted to wait until then to release the exploit so people could legally run GTA 6 on their hacked PS5s. Disclosing the exploit before the release means that they'll patch it before GTA 6 comes out so this is no longer an option.
I think this is unrelated because it happened after theflow0's statement, but Sony just released a major PS5 update that significantly increases the PS5's security ahead of GTA 6's release. Apparently it's impossible to rip games now without a hypervisor exploit, and since the last one just got reported to Sony this means that even people with hacked PS5s on old firmwares won't be able to pirate GTA 6 because nobody will be able to rip it. https://www.reddit.com/r/PS5_Jailbreak/comments/1wi0gpx/its_...
An old guard always tries to enforce an ordering of respect based on seniority and who they think has earned it the most. Outside of a terminally online circle of Discord users few people care. They only want the thing so they can use it.
LLMs are a big disruption because now because effort and results have never been more uncoupled. When a kid with an LLM can do a sloppy but good enough version of the work in 1/100th of the time with 1/100th of the experience, the social hierarchy only matters to people who value it above the outcome itself.
"Commodification" might be a relevant word here.
You can fight that by "building a personal brand", but then you're suddenly brand building instead of hacking, and hacking was what you actually wanted to do.
I guess it works best if you're not in it for clout but because you want something to exist. But even then it is difficult.
> There were also 3 people who found the same exploit independent and some large amount of money on the line for the first of them to report it.
Ah yes, game theory. Oof.
It is insane just how miserable the experience of FOSS hardware hacking in public is.
The expectation does not even the slightest match reality. You'd think "ah yes many eyes meaning all bugs get shallow", but instead you get worst of XDA-Developers and toxic wastelands where no sane person even answers anymore.
But this predates LLMs and was as miserable as it is now before as well.
In fact, I might even argue that LLMs made this _better_, because you can now avoid the "opening up in hopes of finding 1 helpful person below 99 annoying ones" through simple GPU compute.
Previously, you had to hope that through this self-inflicted horror, you'd find an expert that can augment you. Now that expert rests on huggingface.
It's still.. not perfect, of course. But it might be less miserable - provided that you adapt to the current state of things and stop with the "trawling for volunteers".
__
Of course, this does not help you against "skids let claude find bugs that you'd need and burn it for no reason" as per the twitter thread, but I wouldn't rule out that they would not have done that, if less information was public.
And.. that too was an issue before LLMs.
Information wants to be free, but so does your cat, and your cat gets run over by some crackhead in a 30 year old rusty pickup if you just put it outside without thinking.
So don't let it go out unattended.
That said, this "pep talk" is more directed at myself than at poor Andy. This must all suck big time.
Complaining about the inevitable toxic noise when the same boneheaded development decisions are made over and over like everyone has gone insane. You don't have to build a death trap on the land your cat and children roam.
Just like humans by their very nature are low quality, since they come from the biology ecosystem, where everything is built atop everything else.
Filthy carbon-based mammals.
And once in a blue moon something good comes out of it back to the real project.
Cherrypicking the occasional winner is just a side benefit.
This is definitely the case for me. Before AI tools became mainstream, it was already a difficult proposition to find other smart people who you could get along with and talk to, do something interesting together. The Internet made all the difference in my life because I was able to get outside my geographic region to do big things through open source and hacker communities. Now, that very important filter mechanism no longer works. It's Eternal September all over again. In a way, it's very much a domination of "ends" over "means" in the wider community that is being forced upon those who long focused on "means". For a lot of intelligent people, understanding something is /valuable on its own/, but for the wider world there is no value in simply knowing things, but what you do with that knowledge (or now that lack of knowledge). I even experienced this recently at DEFCON 34 where I saw other participants in some of the CTFs with me using AI tools and not really understanding what the tools were doing or what was happening, but just kind of bruteforcing/tokenmaxxing their way through. This isn't to say that those AI tools are fundamentally a bad thing to use in building open source software, security research, or even as a tool in a CTF, but that the "understanding" step needs to still be present or it destroys the fun in everything.
I'm certainly not having as much fun with computers these days, even as I've invested a lot of effort myself in local LLMs and trying to understand the tools and understand how to apply them reasonably, I've found I prefer much more analog entertainments. Thankfully there's always photography and lockpicking to entertain me at the moment and provide a pathway to meet other interesting fellows.
People who hate their job of course like to come out of the woodwork and say no one should enjoy it, but isn't it nice to have a society where at least some people can enjoy their work? I used to enjoy teaching but I'd never get a teaching job now because of how AI is being used in that sector.
Technophiles will say that we should embrace the future because its inevitable but how many good people quitting does it take before they realize that a vibe-coded future of fun isn't all there is to life?
That’s an interesting question. I thought about it for a minute and was surprised that I came to the conclusion that the answer isn’t obviously “yes”.
An analogous question is “isn't it nice to have a society where at least some people are rich?”, and I think that question should make it clearer to many people why that is so.
There’s a crucial difference between the two questions. “Rich” is a relative term: If everyone had the same amount of money, no one would be rich, you need someone to be worse off (poor) to have someone better off (rich). But someone enjoying their work has no bearing on someone else’s enjoyment of theirs.
the idea of gatekeeping is often seen as elitist or exclusionary (fairly enough in many cases) but i think this can be an exaggerated description of a culture that necessarily requires a standard of... let's say, desire to engage with material on a sufficiently deep level. many things can be for anybody, but they are not for everybody.
in the past i've seen the phenomenon of "opening up" subcultures or previously-niche intellectual/art fields described as democratization but i think that ignores a big part of what causes this, which can more accurately be described as commodification. access to difficult things was formerly measured by one's ability to expend effort in order to get there (ignoring, for now, the structural conditions that set one up for success in that effort). when these things are commodified, these efforts and identities become products to purchase, the right to which is nearly never limited; in fact, it's almost seen as evil to imply that they should not be available to any individual at any time that individual may desire access.
i know we all have to start somewhere, but there has always been some historical filtration that leads people who are not truly engaged with a subject on a deep level to disengage at some point. that's changing at a novel rate and scale across so many subcultures. it seems like a lot of us are just surprised at how many people even want access to what were once our sanctuaries and we're not capable of grappling with what it takes to adapt to these changes.
i don't think this will pass or that things will return to "the way they were" but there will always be pockets that resemble previous subcultural forms. we just have to re-learn how to identify them with a keener eye and how to better avoid or more-appropriately interact with those who have a more superficial interest in them.
It gets bad when the subculture inhabitants get confused and adopt the social norms of the passer bys instead of remembering the importance of well-kept gardens. And then they start to introduce "policy".. which is just a backdoor for attackers to destroy your well-kept garden by arguing policy (as if that was what the subculture was about!).
true, but i think there's historically often been good-faith efforts to engage with newcomers in any field that requires intellectual or artistic curiosity or experimentation. what we're seeing played out is that this default good nature ignores the risk involved in growing a small garden beyond one's own property. there is a change in meta-social requirements at scale.
the extremes of this are super apparent in FOSS - one side of this being death-by-committee and overgovernance at the expense of the original project (requiring a support organization that outgrows the actual "work", for example, look at how many HNers view unions or internal policy committees), and the other side a harsh rejection of newcomers or calcification against new ideas at the expense of the long-term viability of a project. these issues can be imperceptible or not important in smaller projects.
but they're not limited to FOSS. i think these are probably fairly well-studied ideas in any form of organizations - business, social groups, churches, non-profits, unions, etc. i don't really know where to start to learn more about this or what the right approaches are (and i suspect they're often pretty unique to the group in question). i don't have an answer but i'm really interested in the huge grey area between fully-gatekept cultures and fully-open ones.
It doesn't matter if you have no interest in <autistic specialty>, the point is that you can force a bunch of nerds to bend to your will.
remember hacktoberfest 2020? that's just all public-facing source 365 days a year now, except instead of "updated README.md" it's some vaguely-plausible fix... then you read the PR body and someone couldn't even be bothered to, or, just as likely couldn't explain it themselves. and that sort of sinking dread sets in.
Oh man, if you read the threads about that it's such a time capsule of a different era:
e.g. from this thread: https://news.ycombinator.com/item?id=31628342
> I am honestly surprised how little SPAM there is on GitHub in general. Please don’t take that as a challenge!
At first, my brain parsed "spam" as in ye olde email spam. It took a moment for it to sink in that you meant code spam, instead.
But now that the two concepts are linked in my little pea brain: I kind of want to see how a system like SpamAssassin would work when applied to pull requests like it has been applied to email.
It can use reputation, real-time blacklists, triggers for form, and et cetera, with weighted scores for every aspect that are ultimately factored into one final score.
If final score is passing, the PR is presented for a human to review like a PR was (say) 5 years ago. If the final score fails, it goes into the circular file where it will probably die.
I've been on both sides of the spam arms race at different times of my life. While they'll never be able to claim victory, the good guys (usually!) seem to be winning -- and that's a lot better than accepting defeat.
I entirely sympathize with these maintainers too. I've had 2 instances where an LLM has surfaced a bug and I just couldn't get myself to open a PR and dump more work onto these maintainers, even after manually writing one up (neither were critical bugs, it's fine).
Seeing popular projects (like hermes) having 5k issues and 5k pull requests is madness.
It's actually got nearly 30k open pull requests!
Why not set up a triage bot with only read permissions on the project and restricted network access in order to triage issues?
Perhaps this way one could turn the influx of spam into a source of useful information.
For example, I recently came across Hucre, https://github.com/productdevbook/hucre, which is a JS spreadsheet library apparently developed entirely in the past few months and which has already gained 2.2k GH stars.
Is it any good? Who knows, but the alternatives for spreadsheet handling in JS aren't great, either being limited, semi-commercial, or unmaintained. And creating a new one without LLM-assistance is a huge, painful, mostly thankless undertaking. It's not surprising that a zero-dependency option that promises to do everything this can do would be popular.
Everyone has had the experience of butting their head against functionality limitations of open-source libraries. Fully vibecoded libraries will be able to add functionality at a rate that human-authored ones can't. Code quality might suffer, but if a library has a feature you need, and you've got a deadline to hit, are you going to avoid using it? Is the average developer? Or the average LLM?
I think we're about to hit an interesting period of human-only projects competing with vibecoded ones, and it'll be an acid test as to whether the pro and anti claims about AI-coding bear out in terms of code reliably.
https://x.com/theflow0/status/2099987019954831744
Vibecoding has been the norm for months, it's the embargo violation today that triggered his resignation.
That's your editorialization.
Eventually comes the straw that brakes the camel‘s back
You know, it’s petty, but I think one of the things I hate the most about AI is that it surpassed front end JavaScript frameworks in terms of changing what the standard is every few years.
What’s the point of learning anything if it becomes obsolete faster than the seasons change?
Slop kiddies using AI discovered the PS5 hypervisor exploit it relied on for installation. Initially they agreed to his request to delay reporting it to Sony until after GTA6 came out (so users could at least install and enjoy that highly anticipated game). But then they turned around and disclosed it anyway (the same or next day?).
They presumably gained a nominal bounty, but nuked the project he'd poured so much hard work into. Including support for the PS5 Pro he was preparing to release next year.
The community used to be a group of talented researchers, but he's frustrated it's diluted into participants who aren't aligned with his values and don't even understand the hacks they produce.
I don’t know if he’s mad AI scooped a bug? Or that LLM slop kiddies don’t pay attention to that something is already known?
But I guess Sony being a gatekeeper wasn't a gatekeeper enough for certain regulatory agencies.
Sounds like he is salty that somebody found an exploit using LLM that he found manually (which probably took a significant amount of time.) I can partly understand it, but I mean that's also just the game that somebody else might find an exploit, LLMs just make it easier. LLMs finding bugs is not a bad thing, just sucks for enjoyers of open source software in this particular case.
You can probably find more though.
This guy has used on working with people that understand the scene, it seems that they were in contact, they agreed on something and then the next day they did something different.
This is really important in the context of what happened and probably the cherry on top of the current "hacking" cake, with the bar being lowered so much that anybody can jump in with some minor skill and luck and get something just for themselves.
Nope. He is salty because someone made public the secret exploit that Linux-on-PS5 apparently relies upon to bypass Sony's hypervisor protection. Now Sony will fix the exploit, and there will be no more Linux on the PS5 until another exploit is found.
No, he's salty that this last remaining hypervisor exploit is going to get patched, causing his PS5 Linux project to get wholly-fucked as now there will be no (currently-known) way to sideload the OS. Reading comprehension is very important here.
I can guarantee this post would not have been made had he not been the one to find that vuln first.
> I am stepping away from the ps5 scene and stopping all my work on ps5 linux. After pouring my heart and months of my life into it, including plans to finish ps5 pro support and release in 2027, it's all down the sink.
> The scene used to be a group of highly talented researchers, but now it is just a bunch of noobs using LLMs and writing hacks they don't even understand. Slop kiddies found the only hypervisor bug left, which I had also found a while ago, and decided to report to Sony.
> I asked them to at least wait for GTA 6 to come out so that people would have the opportunity to legally purchase the game and also enjoy linux. They agreed to wait, but not a day passed and they decided to waste it instead.
Person 2 uses an LLM and finds the same exploit.
Person 1 asks Person 2 not to report it and collect the bounty until GTA6 is released. Person 2 agrees.
Person 3 also finds the same exploit independently.
Person 2 discovers that Person 3 has found the exploit. Person 2 decides the cat is out of the bag and submits it to Sony while they still have a chance.
Now the community is angry that Person 2 didn’t sacrifice the bounty. PS5 Linux effort seemingly falls apart in response? Departing developer directs community to be angry at Person 2, who is taking time away to be with their critically ill mother.
Honestly I can’t blame Person 2. They earned the bounty and played by the rules of the bounty program. The PS5 Linux dev who abandoned the project and started deleting things is entitled to do so, but blaming Person 2 for the crash out is too much.
Yeah, nothing like the hard work of typing "look at this binary and find a bug" The sweat, the tears it must have taken!
The link is not loading for me, so I could not access the article.
It's an issue that the dev attempted to collect the bug bounty, AI or no
Grandma was always a broken record with that stuff. The family would sit around that table, apparently, gabbing about nothing, and everything, just staring into a raw pizza, pulling and stretching it, starting over, living with their hunger, for a flawed process to bake slowly.
These days, fresh pizza is 10 seconds away, it's always identical and we never have to share. It's hydrated, eaten, and in the trash by the time I am onto my next attention, always perfect, always on time, always identical. I don't think about this much, but I sometimes really feel pity for what the old timers suffered through, all those ridiculous, pointless wasted interactions and delays, sitting there for what felt like ages, for a random pizza shaped thing.
I dont get it.
That would indeed be incredibly demoralizing, even crushing. Quite a dick move.
Now that said, I imagine it was only a matter of time anyway until Sony found/fixed or someone else did the same thing. It's just a different world now.
As much as I'd love a non locked down PS5, anyone buying one knows what they're getting. If you care about user empowerment, PC (Valve hardware, etc) is the place to put your money and time. Sony is actively hostile toward you and wants you locked down, and trying to fight it with exploits is destined to be a nasty cat and mouse game. Go with a vendor that is more aligned to your values.
Not to mention how the code can then be sourced by an AI model in an instant without any credit.
On the other hand, it’s been clear for a while that software as we knew will end up at a close to 0 marginal value.
Of course gatekeeping can also be toxic. But anything can be toxic if applied too much. You can die from water poisoning, that doesn't mean water is bad. It means you need to not overdo it. I've seen what a lack of gatekeeping has done to many communities I used to enjoy (including programming), and I think it's high time we did more gatekeeping. We don't want to overdo it, but right now we are doing far too little and that needs to change.
> Slop kiddies found the only hypervisor bug left, which I had also found a while ago, and decided to report to Sony,” the modder said on social media. “I asked them to at least wait for GTA 6 to come out so that people would have the opportunity to legally purchase the game and also enjoy linux. They agreed to wait, but not a day passed and they decided to waste it instead.”
So what has really happened is the LLMs have lowered the participation floor for this space enough the dynamics are changing. The new comers would rather have a few dollars vs. the founders who would rather have a project. It’s likely the projects days were numbered either way because Sony could also just take a frontier LLM and examine any released installer for the project and reverse engineer and bug.
How old was this bug? How much energy has been devoted to RE of this proprietary console? Not enough, apparently.
This vulnerability will still exist in older versions. The project can still continue development of Linux on PS5 and, eventually, another exploit will be found that enables the installation on a later version.
Frankly, based on the language used, a resignation over this seems to have a lot more to do with the person being upset that LLMs are lowering the bar for entry. They seem more upset that their skills aren't as useful as they were.
It seems like the reputation as a PS5 hacker was the objective, not getting Linux running on PS5.
Hopefully "people" doesn't mean scrapers
It's just boring. And the people that crow about "their" accomplishments are tiresome.
If one user could have found this using AI. Then I would imagine anyone else could have found it.
Right, including Sony. AI finding security flaws is very good in general, but one downside is that it will become easier to make "secure" devices that are hostile toward their owners.
People are still fixated on using AI to produce code (to reduce salary costs/dev time) rather than using it to audit bugs in one own's code, which they are better at.
The latter has "always" been obvious to me.
Ever since consoles became moving targets there's been deliberate gatekeeping - specifically, drip-feeding of bugs - to maximize the chance someone can actually use them to break DRM and install Linux. This relies on the fact that most people do not want to have to become FreeBSD kernel experts in order to install non-PlayStation software on their PlayStation. But if everyone is vibe-hacking their PS5s then none of this logic applies. Any bug Claude can find is one Sony also knows about and will get patched, possibly before you even release an exploit for it.
How this ultimately plays out depends on if it's even possible to write software without bugs. Maybe this reaches a new equilibrium where people are paying Claude to vibe-code jailbreaks - as I'd initially hoped. But it's equally as likely that this winds up reinforcing DRM rather than weakening it, for a few reasons:
1. Anthropic's AI safetyism culture encourages the prohibition of vibe-coded jailbreaks. The fact that the model runs on a server and people are spying on your chatlogs means Anthropic has actual knowledge of who is actually using their service to find PS5 hypervisor bugs. Letting Claude break DRM is legally risky; DMCA 1201 implies the only lawful way to break DRM is for you to find your own bugs. So it's probably not going to be long until everyone vibe-coding jailbreaks will get banned.
2. Sony will not be getting banned from these services, they will get trusted access as they're big enough for Anthropic to sue if it gets misused.
3. The attack surface of the thing you have to actually compromise to get code execution on any locked-down system is really small. The Xbox 360 had a 15+ year gap[0] of no softmodding because they'd isolated all the memory protection into a hypervisor. Apple learned the same lesson and iPhone jailbreaking went from incredibly commonplace to "if you know how to do it someone at Zerodium will hand you a million dollars to write spyware with it".
[0] AFAIK, the only two actual softmoddable bugs on Xbox 360 were the King Kong hack right at launch, which got patched in like a week, and that BadUpdate thing last year.
AI skynet is currently winning the war.
LLMs have taken over so many projects already. If I were young, would I want to contribute to projects maintained these days via AI slop? I would not find that interesting at all.
It seems more like a spirit drainer for the experienced maintainers who have to deal with the onslaught.
I suspect we’re going to see much more strict projects with fewer allowed contributors going forward.
Though on the upside, an experienced dev can use AI to become more productive, so perhaps they will be less dependent on contributions.
I might be showing a lot of unc energy here, but if you can't afford a raspberry pi or something to play with linux, or a used pc, gaming and having a playstation 5 should be de prioritized for a bit while you get your life together.
Your comment is framed as though Linux usage and what you deem an unstable lifestyle (lack of monetary means in your judgment) are mutually exclusive. Open-source software is for everybody, including the messy or disenfranchised. Would you frame a kid who got a PS5 for Christmas who doesn't have an allowance or job as a failure because they don't have $100 to spend on a Pi? It sounds like you just look down on people playing video games even when they want to use the very thing you're implicitly deriding to do the thing that you think they should be doing... doesn't seem to make a lot of sense.