Advertisement
Advertisement
⚡ Community Insights
Discussion Sentiment
63% Positive
Analyzed from 7131 words in the discussion.
Trending Topics
#software#code#more#don#free#open#things#world#source#llms
Discussion Sentiment
Analyzed from 7131 words in the discussion.
Trending Topics
Discussion (126 Comments)Read Original on HackerNews
Is a social contract being broken? Yeah, kind of, but the problems that that contract existed to solve are no longer a thing. Creation is now easy and commodified. We finally have computer we can interact with in natural language, something people tried to do for at least 70 years and never made any significant progress on until LLM arrived.
If you want to gatekeep or only create stuff to boost your own ego or portfolio, then AI might be an issue, if you actually want to build stuff, AI is godsend. We are essentially living in the StarTrek future with Holodecks and replicators and people still find reason to complain.
Relieving yourself of thinking and effort, whether through a machine or another human, is not the liberating force you think it is, especially when that effort isn't just grunt work, but the very process that helps you develop and grow.
The biggest barrier was time, there are only 24 hours in the day and no amount of hard work or knowledge is going to change that. There are just some fundamental limits of what you can accomplish as a single person in that time. And good luck trying to find contributors who want to work for free, when they already are busy with their own projects.
AI just fundamentally turns that around and gives you a whole bunch of extremely capable co-workers that you can let deal with all the problems you do not want to waste your time on and they let you focus on the stuff that actually matters to you.
OSS models are strategically important, but that is a different matter to getting value out of them for OSS software development.
Download the files as they come out if you're worried, but there's no way to roll LLMs back beyond what we have in open-weight models right now. It's a ratchet.
This seems both inevitable, and an occasion to tout the https://www.fsf.org
Exactly this. I've been very confused by the free software advocates that seemed to hate AI until I realized their reasons for releasing software under an open source license were very different than what I assumed they were.
1. The credits for my code are protected (with the GPL you have to tell where your code originates from). That's the ego part. It's important to me because I'm not paid for my software. So credits are an important reward.
2. I want people to think twice about reusing my code. I use the GPL license because I think sharing software is the ultimate goal. So I force people to share my software by using the GPL. That may sound "extreme" (that's the whole open source vs free software debate) but, not being a full time politician, I can't change laws to push society in the direction I want. At my level, that "push" is the GPL choice. Maybe it's not noble enough, maybe it's cowardice, but it's my way (compare that with those who simply don't care).
AI severely weakens both of these. And for people like me, this forces us to reconsider our position. For my part, I accept the legal point of view that A.I. doesn't steal code, and just reproduces the ideas in the code. So, as far as ideas can flow in society, I'm OK with that (that's the principle behind copyright laws).
If AI has its way, one day one will not need to write software, we'll just ask the AI. In that case, software will be dead and free software will die with it too. By then I'll do my "local politics" another way and follow the next RMS.
But that's literally anathema to the spirit of GPL. Copyleft exists only as a reaction to copyright which is sadly ingrained in legal systems, but the original thought about free software, at the time of GPL inception, is that in an ideal world, copyright shouldn't exist for software ; it's leveraged by GPL only to protect against abuse of copyright holders that could close open code, which is thus made impossible "legally" with the GPL. AI makes this distinction fal into "practically" as pretty much anything is "open" for individual use now (e.g the only use that matters).
https://www.gnu.org/philosophy/fsfs/rms-essays.pdf
Then they don't need to train on github, no? Why not release a new model trained from Knuth's Art of Programming, Cormen's Introduction to Algorithms and the C specification.
Feel free to throw in any other published literature related to STEM, but stick to the code samples from the books.
I'm certain it'll be able to change the color of a CSS button, right?
I also don't think that just because you have to ask AI to write the software, free software will die. Because people don't understand their own requirements, I don't think we're going to get to a place where AI can one-shot, even moderately complex software, and so creating software will continue to be some effort. I fully expect that the norm will become that we give away free software and expect other people to pick it up and tune it to their own needs with their AI. But that doesn't mean that free software is dead. It means it evolves.
Nothing up my sleeve.
This of course requires audit and that requires that the code is written for human consumption, otherwise nobody will bother. Sure you can vibe a printer driver but how sure are you that your LLM didn't include a backdoor in the millions line of slop?
Even before AI we heard lots of complaints like "I made a popular open source library which is now used by corps with trillion-dollar market cap and I don't get anything out of it; halp". There was always some kind of a conflict, now the nature of the conflict just changed
One of the major cultural problems in open source software is it got dominated by people doing it purely for self promotion. Then it becomes an interview question, then all the incentives are warped on the promise of “get PRs merged, get paid big money”.
But yes, you are right.
Contrast that with most other businesses - tech or otherwise - where there's always strings and trickery attached to any transaction.
> strings and trickery
One could argue that at this initial stage, just as with surveillance capitalism and services like "free email", the general public is being treated like the natives who sell their land for a few trinkets. Once we are passed this stage and just like other surveillance tech our social and economical life becomes effectively dependent on these services, we can review if we have not sold our future for some (arguably dubious) "value".
Go back to early '00s. How did you "value" the "transaction" of handing over the handling of your personal electronic correspondences to a corporate entity that may or may not be an extension of the security state?
Does anyone trust Ai companies not to eventually spy on you and feed you ads? It’s not like we haven’t seen this playbook before.
And the opposite is true, as well. Many groups with deep pockets are rewriting Free Software packages with permissive licenses to kill the GPL counterparts, so the companies can sell closed source software built on the effort of thousands.
So it's not all pink fluffy unicorns dancing on rainbows.
Right... I bet Microsoft wouldn't mind at all if I modify Windows or Office.
Apple has feasibly stopped any modifications of iOS and their apps, for all practical purposes. These kinds of ecosystems will only continue to expand and to displace more open ones. We’re already at the point where arguably the most performant non-server hardware (Macs with the latest SoCs) is bound to a proprietary OS. Efforts like Asahi can easily be shut down by Apple with newer hardware.
LLMs are no help against proper cryptographic lockdown.
LLMs evened the battlefield for all that has been developed so far, but what about future discoveries? I think it remains to be seen if LLMs can come up with these novel solutions rendering innovators useless. If not, then LLMs might be crippled by software becoming more closed in the future.
Maybe AI is the best thing for the free software world, but not the world as a whole.
It could be that AI is the tool the world needs to solve problems the world governments have been deadlocked to solve in the past 50 years.
I'd like to think too that the person who can sit quietly in a room and think has an evolutionary advantage over, say, an influencer on tiktok doing silly dances, but the reality seems to be more and more that this is wishful thinking. Nerds have made themselves irrelevant.
I fully agree with you.
It's easier than ever to build compatibility for more architectures and devices than ever before, to autonomously test it, and ensure UX rough edges can be rapidly iterated upon across platforms.
This extends beyond software. Nobody proofreads or otherwise edits what comes out. They dump it on the rest of us and demand that we thank them for their “effort.” It’s selfish behavior.
An alternative near future is that what you're describing is used to undermine/rightswash strong copyleft free software for use in proprietary products, while owners of proprietary software (and big movie studios and record labels) start protecting themselves with EULAs forbidding ingestion of the works into LLMs.
Another possibility is the one others sketched, where truly user-controlled models are legislated away.
Do we really believe that Rockstar would be ok with someone feeding GTA6 to a hypothetical LLM and get a "free" reimplementation out? If that world were to come to fruition, I'd maybe buy the "best thing to happen to free software" story. Otherwise, my bets are on "complete and utter stomping of small IP rights holders in favor of giant ones". In that world, free software is in real trouble. Together with indie artists and writers. I lament how many people don't seem to take this scenario seriously.
We hid our “we know better” hubris under the term “disruption” because the reality (breaking everything) was a little too unsettling for us.
We ignore laws and regulations where we know better of course. Don’t you love having a homey place to stay while travelling that has just a few weird rules, a small to-do list and stays spotless thanks to that cleaning fee?
And look at all the good we did! A whole new world of slaves (oops gig workers - sorry!)
And of course we’re doing it again with information and content. We should be in charge of monetizing all your work because you’re not responsible enough to do it right. It furthers our need for power and control. Oops we meant to help make the world a better place (We keep doing that, sorry.)
It is not how I roll and it never has been. I don't and won't make things that are responsible for putting people out of work; I make things that make their jobs less shit. I won't make choices that make things more dangerous or less ethical.
This is a choice you can make. Beware of sitting back and saying "we" when you could be in a position to say "you".
It's possible to do no deliberate evil, to avoid using euphemisms for firing people, to avoid fire-at-will culture. It's also possible to fight against major ethics lapses and immorality.
At the best — highest-paying, most dynamic, most fun — job I ever did, I probably did more good in the relevant industry in one afternoon by writing down my concerns, printing a resignation letter, making both my employer and their client aware it existed and offering to sign it, than I've ever managed since. (You can maybe only do this once per working lifetime; use it wisely)
Even the project I worked on that I was sure would put dozens of identifiable people out of work didn't, because we found a way they could use the product to continue their original tasks until their existing contracts expired/they moved on/they retired and their team could be scaled down through gentle non-replacement.
One of the earliest things I was taught about system design is that sometimes even jobs that appear to an outsider to be noisy, exhausting or miserable give people purpose and meaning; you have to look people in the eye when you talk about things that could eliminate their job role. You don't replace a job that doesn't need replacing. And you have to look at the things they do with care and duty and make sure your systems do the same.
If you come from a corporate culture that treats this as anathema, you should work to change it or quit.
Silicon Valley excels two things: building moats and firing people.
And the relevance here is how this disruption played out. Will the same happen to open source? See it already for instance in how AI makes some maintainers burn out. Where will it lead?
The owner of the company lead us to a large open office with about 30 people working in there, mostly women, and whispered to us that he expects he'll only need three of them after subscribing to our product.
That's when I realised the brutality of what we are doing, and the sales guy I was with realised we should be charging significantly more.
In this case, a system that aided the displaced workers in finding new positions and acquiring skills that are not simply doordashingfor rent (and still counting that as 'full employment').
In this latest disruption, highly skilled workers are being underemployed in low skill labour and we all lose out. PhD and JD to baristas and uber driver economy.
The federal funding and employment disruption alone will take decades to fix, if ever.
Anywho, you should notice when you participate in creating a massive disruption in many people's lives (to create super-profit for a couple of already wealthy men).
You are never just following orders, don't close your eyes to what you are doing with your life.
And before you 'what about' me. I have refused orders and lost jobs because of it. My only regret is not organizing with other workers beforehand.
But it is worth remembering that the latter is a probable outcome, and that is what our business is, overall. Automation. As in, automating work so it doesn't need people to be done.
The unnecessary hyperbole ruins your argument. Not all of tech is about breaking social contracts. Whose livelihood is destroying the engineer that design better protein folding software? Linus made the world better and richer for everyone. Even the humble startup shipping yet another calendar tool isn’t harming anyone or being the direct cause of layoffs of other workers.
Not everybody works for Uber.
Hasn’t homology modeling essentially been abandoned by researchers at this point? Maybe their livelihood wasn’t completely ruined but if you had specialized in that technology, you were probably materially harmed by the introduction of AlphaFold. That harm doesn’t outweigh the obvious benefits, but I would be very surprised if the harm doesn’t exist.
>Even the humble startup shipping yet another calendar tool isn’t harming anyone or being the direct cause of layoffs of other workers.
If they’re undercutting and outcompeting an existing calendar tool, they very well could be contributing to layoffs at their competitors.
"We"?
And it's not that their services were fulfilling a need, just at a large social cost. Many created a need by using those massive amounts of funding to destroy existing, sustainable services. They're a net negative for the economy and society because they replaced workable businesses (albeit with limited reach because the users bore the full cost) with businesses that will collapse because they're built around ubiquity and forcing non-users to shoulder part of the cost (the only way to break even while paying back investors).
That's not quite right. For a decade, the silicon valley mantra was "Move fast and break things", and it was largely accepted as a good thing. The prevailing wisdom was that this "internet" thing was going to fundamentally change the structure of human society, and nothing would ever be the same again. We ignored the laws, and society broadly accepted that those laws weren't fit for this new world of abundance and information freedom anyway. Big tech was offered broad protection from any responsibility through laws such as Section 230, which basically says they can't be blamed for anything, as long as they structure their services as a "market".
After 20 years, I think we've found that actually the structure of human society has remained largely the same. The things we all need are still the same. The only thing we actually disrupted was the economy, such that we now can't produce and disburse the things we need.
Except for something like housing, the supply of which has been artificially constrained by policy since before the internet arrived on the scene, I can’t think of anything which is harder to produce or distribute since the advent of the internet. Particularly on distribution, I have far more access to goods and services than my parents did.
Agreed that this hasn’t changed the structure of society in any meaningful way. We’re still social animals with all the same strengths and weaknesses as before.
By the people not involved in the things breaking maybe. If you didn't drive a taxi or run a hotel the tech companies "disrupting" things by breaking laws didn't affect you directly. Now with LLMs, they do.
You have the same incentive you had to share your work as before, and that is to get attention, and customers, assuming that's your game. Open code means no vendor lockin for a lot of customers, so they can pay you but also trust you to not extort them. And if you're hit by a bus your product lives on, and someone else can adopt it.
Supply chain risks and vulnerabilities existed before LLMs came along. They're easier to handle now that we have LLMs helping us. In our org the tsunami of updates we need to do weekly is far more easy to handle with LLMs.
Open code has always been easier to find vulns in vs closed. AI didn't change that.
Yeah the slopfest is real, but easier to deal with thanks to agents/LLMs so it kind of offsets itself.
Your licenses are still enforceable in court. Agreed that not being able to reverse the fact that AI trained on your code and is selling that capability kind of sucks. But humans were doing that before AI.
Yeah on the one hand opening your code got you credit which was nice for the ego and for getting paid, and AI trains on it and doesn't give credit where it's due. But on the flip side, we get AI! Which I frikkin love. I feel like a kid in a candy store. It's training on my code too and it's training on my content. And when people ask about what the best product is for our space, the AI tells them its our product. Woohoo!
Regarding the future: We have some really really big problems that need solving - stuff that creates a massive amount of misery in dark stuffy hospital rooms with crying relatives saying goodbye to their 9 year old child. I've been in those spaces and I'd give up the previous generation of open source ethics in a heartbeat to make just an ounce of that misery stop. The training that my code provides AI is a tiny little part of that solution, and I'm proud of that. Whatever I can do to push our capabilities to the point where we can make the major breakthroughs this species needs, I'm happy to provide.
LLM’s are pouring massive amount of gasoline on existing issues and people just keep shrugging. Fake news always existed. Now one dude in India can flood multiple sock puppet media accounts with right wing content/images (actual example from a few months back) at a scale previously unimaginable.
People could always die crossing a street. Still, cars changed the discussion about pedestrian safety pretty materially. People didn’t simply throw up their hands and go “people have always been able to die crossing the street.”
A guest on a podcast said, in response to open source and community websites being flooded with AI scrapers, "the internet has always had people scanning websites; get over it".
I still respect the podcast, but that was such a shitty take. The difference between before and now was that those websites started closing their doors instead of paying the increased hosting feeds.
I'll get over it when we stop giving people a pass for the damage they're doing just because they're a corporation.
That is kind of net loss at this point. Hey, on the bright side we get onslaught of slop, ai psychosis, constant stream of doom trolling.
And ideology of pointlessness where any time you do or learn anything, you get told that why bother you should have used AI.
The kid forever locked in candy store is happy for a bit, but then they get hungry and feel bad. And no matter how much sugar you eat, it wont get better.
From technological enthusiast perspective - if you can't find an endless stream of uses for this technology, I really don't know what to tell you anymore. I gave credence to AI naysayers for a while, but at this point I feel like its akin to denying gravity exists.
Who are we to gatekeep software development? So many people have gained the ability to interact with computers in ways they never dreamed of before! For me, I've never felt so engaged in software development, even if I'm no longer writing it line by line.
Like you say, there are a lot of negative externalities to this technology, but its something we're going to have to solve rather than dismissing it outright. The industrial revolution caused all sorts of problems! But you can't argue we're worse off because of it.
Sure, artisanal code in itself isn't something inherently sellable but if you pride your program on being a quality product then it's still valuable for others:) AI is basically the new JavaScript in a way.It won't create the next Linux or the next SQLite by itself.
Who cares? Anyone can tell you anything online.
And frankly, I think most of the source of outrage is this:
> Yeah on the one hand opening your code got you credit which was nice for the ego and for getting paid, and AI trains on it and doesn't give credit where it's due.
Turns out, a lot of people didn't really do things in the open to benefit the others, in pay-it-forward style. They just did it for selfish gains. Which is fine, just like keeping source closed and selling licenses is fine. The problem is with lying - doing something for personal gain, while claiming it's for greater good, thus getting more gains through dishonesty.
LLMs just shone a light onto it. People who had betterment of others on their minds, don't have a reason to consider LLMs training on their output as taking anything from them. On the contrary, their outputs now contribute to a general-purpose problem solving tool that will (and already does) help humanity with way more problems that anyone imagined.
I personally am more than happy to know LLMs may have trained on my content. I don't begrudge the companies the $0.000001/year they probably owe me for my relative contributions. I get orders of magnitude more value for myself from LLMs every day, in my personal life alone.
There are other reasons to dislike LLMs and fear or hate what AI is doing to the world. But people who feel something was "stolen" from them, who now close their blogs and turns repos private because LLMs - they're just showing they had ulterior motives for their work - which again, is fine if they were up-front about it. The OSS subset of those, just paint themselves as being grifters all along.
Keeping your source code private doesn't save you. These LLMs are really good at decompilation efforts. I've seen an insane number of clean room ports of games the last few weeks (just saw a Zelda 2 PC port this morning). Even with that, I don't share the gloomy perspective of the author.
Suppose you're trying to reverse-engineer some proprietary tool, for instance. If you're doing that with human experts, you pick experts who haven't seen the code of the tool, or any disassembly of the tool, or any potentially tainted non-clean-room analysis of the tool.
Even if you have two separate AI instances do the RE and the reimplementation (which most people don't), the AI you use may well have been trained on the proprietary source code, or on any number of disassemblies/analyses/reimplementations/etc that aren't clean-room.
That's doubly true when people do ridiculous things like AI reimplementations of publicly available GPLed source code, where the AI definitely was trained on the GPLed implementation.
There were some hidden downsides to the internet and they are worse with AI. Upsides are better, and downsides are worse. Still largely the same deal we already accepted though. “Information wants to be free” never said information wasn’t harmful.
Three paragraphs earlier, the virtues of openly sharing code were being sung.
> while if I keep my code closed it is far more difficult to find those same mistakes
I doubt that is significant for frontier models. They can disassemble and won't need readable code to understand what your program does.
The feeling of not wanting your code to be gobbled up by AI is something I can sympathize with, but now think it's misguided: it's just accelerated - your code doesn't depend on popularity as a metric to be adopted - and really not that different from sharing with a MIT license, as long as it doesn't up gated behind closed models and walled gardens.
We are not entering a new dark age so much as we are being pushed, by specific actors who make no secret of their actions, and are identifiable and locatable.
> We are entering a digital dark age...
It's interesting (and a bit disheartening) that it took modern AI for so many technologists to wake up to the fact that technology does not always help society.
Yes, the internet has brought many benefits, but "transformed the world in a mostly positive and empowering way"?
What about all the harms we know are associated with social media, especially among young people, including anxiety and depression, bullying, body image issues, sleep disturbances, social media, dopamine loops, the rapid spread of disinformation to manipulate elections, etc.? What about the effects of porn? Sex trafficking? The hundreds of billions of dollars that are lost every year to internet-based fraud? The loss of personal privacy and wholesale theft and sale of people's personal data? The tech oligopoly that now has its hands in politics? The "better to ask for forgiveness than permission" startups that have pushed legitimate businesses to the brink, turned neighborhoods into clusters of illegal hotels, etc.? The countless people who have been pushed into gig work? And so on.
The internet has been mostly positive and empowering to the people who profited in some way from the above, and many of them are now only upset because the latest technological "advancement" is coming to eat them. For a ton of people, the "digital dark age" started two decades ago.
This might not be communism or socialism -- this is whatever the Soviet Union was. There is owning land which is tangible and easy to understand. Everyone owns the land together because it is the means to produce wheat.
Owning ideas is hard to grasp. If a person thinks something unique and writes that thought on paper, they own that thought. Every single machine is an idea: the light bulb, the transistor, the little piece of plastic that holds the two ends of hula hoop together, and the blue LCD. Owning the idea of the process has an extra step, but it is still ownership of an idea.
> To promote the Progress of Science and useful Arts, by securing for limited Times to Authors and Inventors the exclusive Right to their respective Writings and Discoveries;
Owning our ideas and their derivatives is so foundational to the American identity, some Americans might say, "I ain't no communist!" In order to promote intellectual discovery, the Founding Fathers decided that people are allowed to own their ideas, the rights to use those ideas, sell them, and to profit from them.
For better or worse, ignoring and the United States Constitution and a fundamental tenet of ownership of ideas is a non-violent communist revolution.
This touches on the tension between artistic integrity vs. open source and the creative commons. There's been a shift from releasing software to benefit the public domain or "for the lulz" towards treating software more like a piece of artwork you as a creator have exclusive control over, even if it does have an open-source licence.
Sadly or not sadly, the freedom 0 in the four freedoms (freedom for any use) prohibits stuff like "anti-AI" licences, and even if it didn't, the mainstream argument is that you don't need a copyright licence because training upon a work doesn't constitute copying. Of course not everyone agrees with that, but once this is socially acceptable to say, it's also more acceptable to "more directly" copy existing projects, such as by directing LLMs to read the existing code and reimplement it, sometimes overtly, sometimes under the fig leaf of a "cleanroom" implementation.
Fundamentally, AI doesn't change anything if you wanted to do things the previous way - you can still publish your software, others can still use it, you can still forbid AI contributions or AI usage while interacting with your work - but it does surface the hidden implications. Many people do open source for the clout, for their portfolio and for approval from others, and those are things AI threatens, because it devalues software from requiring a huge amount of mechanical engineering skills to create to knowing how to prompt for good results. (see "without respect or credit for those who did the real labour.")
I wouldn't be so pessimistic about the new state of affairs - if creating software is much easier without the existing gatekeepers, a lot more cool things will be created :) People usually create things on their own even when not directly incentivised to do it with the power of law. In a way, this fulfills Stallman's dream - if you can easily modify or create any kind of software then he could have fixed his printer driver.
I really don't see how this would decrease openness, copyright itself decreases openness, and if everyone starts disregarding it then the field of software reverts to belonging to the shared commons.
> Yet, through much effort and 40 years of debate we had reached an equilibrium. Now AI has thrown that out the window.
The only thing I'd like to add here is that "AI" in this sentence should really be read as "the companies building frontier AI models have thrown this out the window". I don't necessarily think the author should have used a phrase like that, because it gets quite pedantic to read posts where such precise language is used all the time. But when we talk about where to go as an industry and as a society, we need to keep that distinction in mind.
The tech is here to stay, but the tech itself is not what's thrown our norms out the window. It's the people running these companies who are putting their vision and their profits above everyone else in the world. Most of us are exploring this tech and trying to figure out what it's useful for. It's a much harder question to try and figure out what to do about the people using this tech to consolidate wealth and power. We can't hold a technology responsible for anything, but we can hold people responsible for their impact on everyone else.
> I now have every incentive to not share my work, while also being wary of anything I find online that has been shared. If it hasn’t been polluted by slop code, it might have been poisoned with a malicious library, send data off to third parties, or itself be comprised of someone else’s stolen work, implicating me in the crime.
All of this was a concern before.
> If I make my code available, AI can be used to more easily discover vulnerabilities to abuse my coding errors, while if I keep my code closed it is far more difficult to find those same mistakes.
This has always been a tradeoff.
> If I publish my code on a public service like GitHub, I am likely to be inundated with pull requests generated by AI bots and inexperienced users, flooding me with mostly useless slop and taking all of my spare time away just triaging it.
Then disable PRs?
This guy has four public repos on GitHub, two of which are forks. I get the impression he does more philosophizing about writing code than actually writing code.
LLMs don't affect those who want to gift contributions to humanity. On the contrary - they supercharge that gift. The only affected people are those who sold things, which is indeed unfortunate and I have lots of sympathy for - except for the subset of people who sold things while claiming they're altruistically contributing. LLMs ended up shining light at OSS/creative commons communities and revealed who there was giving things out, and who was secretly just selling stuff and using community goodwill for unfair advantage.