Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

61% Positive

Analyzed from 2138 words in the discussion.

Trending Topics

#code#don#why#llm#policy#spell#own#model#generated#prompt

Discussion (67 Comments)Read Original on HackerNews

Viliam1234•about 2 hours ago
This makes sense.

AI contribution is basically just "prompt + AI work". Even if you are okay with AI work per se, you should accept prompts (after reviewing them) and let your own AI generate the code (and then also review the code)... rather then accept an output of someone else's AI with an unknown prompt, that may or may not include an instruction to create a vulnerability.

In the age of AI, the prompt is becoming the actual source code. Accepting AI-generated code would be like accepting binary code from unknown source.

xpct•about 2 hours ago
I don't think we're approaching the limit of deterministic prompt -> source code mapping any time soon. Small variability in prompts produces medium variability in outputs. Building on previous outputs only extends the variability, where behavioral differences start appearing a few prompts down the line.

And the AI companies aren't focused on making this process any more deterministic, where repeated prompts are sampled using different seeds. I don't know if it's because the randomness makes the models explore a larger space and perform better, but it's probably intentionally done because it'd be quite easy to remove the stochasticity.

Frost1x•about 1 hour ago
There’s another issue where models and transparent wrappers around models that get exposed are shifting around often. Versioning is highly questionable, and not all closed models will be supported indefinitely… so determinism becomes highly questionable at a purely prompt level.
xpct•about 1 hour ago
Oh, I didn't even consider this. Now that you mentioned it, I wouldn't be surprised if the stochasticity is intentional so users don't treat it as deterministic, and the company is allowed to continuously update the model (or even a small part of its weights, perhaps to fix/censor something?).
this_user•about 2 hours ago
Not really though, since the result of the prompt is not deterministic. It greatly depends on the model, the version, the harness, even time of day if the provider's infrastructure is currently overloaded and is silently degrading performance. Some things also require multi-turn interactions.
kylemart•about 2 hours ago
100% agree with this. Was about to write the same thing.
doctorpangloss•about 1 hour ago
this is the unintentional HN humor i come here for
lelanthran•about 1 hour ago
> Not really though, since the result of the prompt is not deterministic. It greatly depends on the model, the version, the harness, even time of day if the provider's infrastructure is currently overloaded and is silently degrading performance. Some things also require multi-turn interactions.

All of that are even more reasons to reject AI-generated code: if it cannot be trusted to produce same (or even similar) output just from the prompts, why accept it at all?

rat9988•about 1 hour ago
This is why I have been asking to fire product owners. Givven the same input, but different software engineers working with them, they can produce different output (code).
pennomi•about 2 hours ago
Except prompts aren’t deterministic, source code is.
kdavis•about 2 hours ago
While I understand the caution, the current policy seems too draconian.

It states in part:

> Until that policy is in place, the Governing Board has approved this interim policy:

> Contributions in the OpenJDK Community must not include content generated, in part or in full, by large language models...

Note, this would exclude most spell checkers, as they often are LLM based. That said, they do soften this with the addition:

> Q: Is it okay to continue using the spell-checking, grammar-checking, auto-completion, and refactoring features in my editor or IDE?

> A: Yes, so long as they are not based on large language models or similar deep-learning systems.

This addition will likely not help as most spell checkers are OS/IDE services and their implementation details are opaque to users.

ekidd•about 2 hours ago
Is anyone using even a tiny on-device language model for spelling? For grammar, I could almost imagine it.

But this also bans "simple" AI-powered auto-complete, like Zed's Zeta2 model. This is a very conservative model that rarely tries to propose more than a few obvious lines (at least in my use cases). If a developer accepts a three-line autocomplete that introduces a bug, that's kind of on them. Honestly, about the only thing that Zeta2 is good for is reducing the risk of RSI.

To be fair, it's also their project, and I completely support their right to set whatever policies they want.

kdavis•about 2 hours ago
The is not exactly my point.

I am speaking of spelling/grammar checkers are part of the IDE and/or OS.

You'd have to know your IDE and/or OS's implementation details to know you are not using an LLM based one.

Capricorn2481•about 2 hours ago
I'm fairly confident mine doesn't. There'd be 0 benefit to using an LLM for something we've had near perfect tooling around for decades.

LSPs vs LLM Autocomplete are a different story, but I can just turn that off.

malfist•about 2 hours ago
> this would exclude most spell checkers, as they often are LLM based

Who is using an LLM as a spell checker?

kdavis•about 2 hours ago
My point is you might be when you wrote your comment or I might be in writing this comment.

However, I don't know if I am as I haven't seen, and will likely never see, the implementation behind the text box that is suggesting the next letter, word, or spelling correction as I type.

yjftsjthsd-h•about 2 hours ago
Can you point at a specific spell checker that is known to use an LLM?
bpicolo•about 2 hours ago
Yeah - spell checking has been on device for literal decades.
rf15•about 2 hours ago
I think it's pretty clear how this was meant, not sure why you feel the need to split hairs here. I'm certain the intention is this:

- spell checkers: ok

- '.getC' autocompleting to '.getColor()': ok

- 'getC' autocompleting to 'getColor()' + five more lines based on preceding code and documentation: NO.

kdavis•about 1 hour ago
If the company making this claim were not famously litigious, I would agree with your "good faith" interpretation. They are, unfortunately, famously litigious[1].

[1] https://en.wikipedia.org/wiki/Google_LLC_v._Oracle_America,_...

xpct•about 2 hours ago
Why is it draconian? If we take Dec-2025 as the point where the models became good for real work (agreed by many), not even a year has passed since then. The world hasn't changed, and there are still many open legal questions.
raincole•about 2 hours ago
> Note, this would exclude most spell checkers, as they often are LLM based

?

Like, what? What are you even talking about? Most spell checkers used by programmers are certainly not LLM based. Spell-checking has always been instant for like two decades. It's such a solved problem.

pizlonator•about 2 hours ago
How do you enforce this?
rileymichael•about 2 hours ago
the same way they currently enforce authors own all copyright in their contributions, via the contributor agreement (OCA). in the real world, people aren’t going to intentionally sneak in LLM-authored code and potentially be legally liable.
asdfsa32•about 2 hours ago
Blockchain.
talon8635•about 2 hours ago
Almost spit my coffee out
htltzp•about 2 hours ago
Best effort, just like in the case of existing contributor agreements that demand you to be the copyright holder.

Or like in the case of checking that free range eggs are in fact free range eggs.

Or like in the case of Steam demanding AI disclosure, to the dismay of Tim Sweeney ...

Let's hope the dismay increases over time.

functionmouse•about 2 hours ago
Subjectively; as 100% of all laws and rules throughout history have been enforced.
talon8635•about 2 hours ago
I suspect people keep asking because it’s becoming, with each passing day, increasingly difficult to distinguish what has been generated from what has not
functionmouse•about 2 hours ago
Look, if nobody knows, nobody cares.
realusername•about 2 hours ago
Open source maintainers just want to avoid slop PRs and it's very easy to distinguish them
stonogo•about 2 hours ago
As best as you can. I don't know why people keep asking this question, when the answer is obvious and exactly like all other contribution policies.

In this case, this is coming from Oracle, which holds the OpenJDK purse strings, so being found in violation is also likely to have financial consequences for the violator.

NitpickLawyer•about 2 hours ago
> I don't know why people keep asking this question

Well, because it's going to lead to witch hunts and drama and so on. I mean, not necessarily on this project, but the same-ish discussion is going on on many community based projects (debian was recently on the front page with 4 proposals, etc).

Marha01•about 2 hours ago
> I don't know why people keep asking this question

Asking how do you enforce a policy that is practically unenforceable is a legitimate question.

Volundr•about 1 hour ago
How do you enforce the law against murder?

Mostly after the fact when people get caught. It's hard to enforce is rarely a good argument against a rule.

lelanthran•about 1 hour ago
> How do you enforce this?

It's not impossible - right now there are all these low-effort PRs. If the PR is indistinguishable from a normal human-written PR, that addresses some of their concerns.

In any case, a rule or policy that can be worked around is not a reason to do away with that rule or policy.

I mean, if we only ever catch 10% of murderers, do you really think it is reasonable to remove that law from the books?

effnorwood•about 2 hours ago
Oracle determining how to add more sypware while not violating their own TOS
pron•about 2 hours ago
What spyware is there in the JDK? It's open-source, so you can look for yourself.
SomeHacker44•about 2 hours ago
Seems short sighted for an interim policy, to me. Why not just require clear and detailed disclosure of the use of said tools, to generate data for which to make a properly informed non interim decision?
pron•about 2 hours ago
Because, as the FAQ section clearly states, the technical and management aspects are not the only ones. There are also legal issues, and until they are clarified or resolved it's best not to let code in that has the potential of causing problems later.

We're talking about one of the biggest and most critical open source projects in the world, and unless there's some immediate urgency, it's okay to wait before taking on some risk.

I should add that the potential loss here isn't big. For any fix, enhancement, or feature in the JDK, the cost of writing the code is rarely more than 10% of the total cost (which is easy to see if you compare the number of people involved in the project to the rate of code being added or changed), and the interim policy explicitly does allow the use of AI where it helps the most.

skwirl•about 2 hours ago
Oracle also has a vested interest in defending an expansive view of intellectual property rights. They lean very heavily on litigation as part of their business model and will want to reserve the right to sue anyone generating software that competes with theirs when the model may have been trained on anything they hold the copyright to.

If they held here that it is OK to use LLM generated code for OpenJDK it could kill these cases later as they will have established that they believe it is fair use.

hajile•about 2 hours ago
All "interim" AI contributions to OpenJDK can and will be sued to make big money off of Oracle if those court cases don't go a certain way.

This is ironic given how Oracle has bet almost everything on AI succeeding.

ofjcihen•about 2 hours ago
Past everything. Even the CEO is leveraged up to his neck in personal debt at this point.
CBLT•about 2 hours ago
The interim policy you're proposing seems to have far different priors. The clearest indication of their stance is that they don't even want bug reports that have AI generate part of the text. You don't take a stand like that (imo) unless you've experienced some serious AI-related burnout.
bpicolo•about 2 hours ago
The copyright issue is an important one. Under the current law, you don’t own copyright on the output of GenAI.
streetfighter64•about 2 hours ago
> short sighted for an interim policy

Bit of an oxymoron, no?

> just require clear and detailed disclosure of the use of said tools

Do you mean disclosure of the use of tools used "privately to help comprehend, debug, and review" contributions? Or do you mean that they should not prohibit AI-generated contributions?

If the former I wonder how useful the data would be, and if the latter, they are probably not (yet) willing to allow such contributions because of the mentioned risks: "to reviewer burden, to safety and security, and to intellectual property."

ToucanLoucan•about 2 hours ago
I suspect one of the principle reasons for the blanket decline is specifically that AI generated PRs are already responsible for a substantial uptick in the amount of work required to be done by maintainers. Engaging in discussions about those PRs may be more fulfilling and useful for the developer but it also then increases that work yet again manifold, so that would likely be highly counter-productive.

What I don't understand is: if you, for example, are a heavily AI-using dev, who spots a problem in OpenJDK, and you use Claude to figure it out: ok, why can't you then write the solution and PR yourself? Write your own code to replicate the functionality that Claude did, in your own style. Have Claude explain why this fixes the issue (it probably already did) and test it. If it works, write your own explanation and submit it as a PR.

I've done this a handful of times for smaller projects, in languages I'm unfamiliar with. Nobody complained because I didn't just copy the shit out of Claude, paste, copy the explanation, paste, and make a PR. I used Claude to increase my understanding, if even a bit and in a necessarily incomplete way, and did it myself.

pron•about 2 hours ago
You can, and indeed that's what we JDK developers do.

But even aside from the fact that writing the code is only a very small portion of the effort in this particular project (you can see that the volume of code making its way into the JDK is very small compared to the number of people involved), I'm often amazed by the gap between how well a frontier model (GPT 5.6 Sol in my case) can comprehend code and investigate a bug, and how badly it writes code and documentation, even when it understands things well. So not only is writing the code not a large portion of the effort in this project, it also happens to be one of the things current models don't do as well as other things.

grodriguez100•about 2 hours ago
> why can't you then write the solution and PR yourself?

You can. The policy explicitly allows you to use AI for understanding the codebase, debugging, etc. It just says “no AI generated content”. So if you use Claude to increase your understanding but then write your own code, that’s fine.

ToucanLoucan•about 2 hours ago
My actual question got a bit lost in my own reply. What I'm really driving at is: Why do people chafe against this?
wildzzz•about 2 hours ago
It sounds like you did exactly what OpenJDK would have wanted you to do, be the human in the loop.
abc42•about 2 hours ago
My prophecy is that in 3 years we'll see a complete reversal of this. Using GenAI to code will be the default and we'll see policies that put limits on human/artisan development. Possibly even projects that outright ban non-LLM development.
Viliam1234•about 2 hours ago
Why would companies accept AI generated code, it they can generate their own (and review the prompt)?

It's like predicting that when compilers become more popular, accepting binary contributions will become the default.

ACCount37•about 2 hours ago
At this point, I wouldn't be too surprised if LLMs just get better at "write understandable, maintainable code" than most developers are.

For now, LLMs are still bad at it, but they're already at "competitive with humans" tier of bad. I expect them to get better.

Sindisil•about 2 hours ago
You might well end up being right, but if you are, I believe it'll be because "most developers" will have become worse at programming, not because GenAI has become massively better.
realusername•about 2 hours ago
I don't think they ever will on the "maintainable" part until their absolutely atrocious memory gets improved at least tenfold. (and no, the tricks we deployed until now aren't enough)

They already are better than most humans at writing code for sure but even the best SOTA model is worse than your average intern at memorization.

ACCount37•about 2 hours ago
That's the entire point of the "maintainable" part: someone with no "memory" of what was written where and why should be able to walk into the codebase, understand how it works, and be able to make a sensible change to it without setting things on fire.

Someone with "memory" should be able to do the same faster, but having that memory should not be a requirement.

Whether that "someone" is a freshly onboarded mid-level SWE or a mid-tier coding LLM is largely irrelevant.

kdavis•about 2 hours ago
I don't know the timeline, but I generally agree.

I think history agrees too, i.e. machine code > assembly language > high-level programming language > prompts.

htltzp•about 2 hours ago
Yes, I'm sure that insecure slop projects like Artifactory will ban human contributions.