Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

59% Positive

Analyzed from 1394 words in the discussion.

Trending Topics

#code#comments#llm#productivity#more#llms#prompt#coding#write#actually

Discussion (16 Comments)Read Original on HackerNews

lazopm•about 1 hour ago
The way I see it you should calibrate the way you work with LLMs based on how confident you are on that specific area, and if it's your responsibility to own/understand it. Here's how it feels for me:

* Learning stage: 0.5x - 1x. I change my system prompt to teacher mode, taking the productivity hit for actually learning the system/tool pays off dividends later. I change my system prompt to "teacher mode" and slowly loosen it as I get more confident.

* Working-knowledge: 2x - 3x. Once I am ramped up enough I feel like I can get a decent productivity boost. Most of the time is spent at the planning stage. This is my mode for areas I don't really own or care about, just need to get work done.

* Mastered: 10x+ I have been doing web front end for 12+ years, I can quickly review plan/implementations and for my initial prompt I already know most of what I want built.

1x == my speed before AI

Aurornis•9 minutes ago
> * Mastered: 10x+

This really needs to be calibrated to the type of work and complexity.

I can actually believe that LLMs would speed up basic web dev work in small, simple codebases 10X for simple requests.

These conversations usually turn into people talking past each other because they’re working on different things. For other less routine and more complex work, expecting a 10X productivity boost is not realistic at all. It doesn’t matter how good you get at writing prompts and reviewing plans. LLMs just don’t solve everything for you in a good way. Some times the true nature of the problem is revealed while implementing it and by deferring everything to an LLM you spend days throwing tokens at the wrong thing. There is a lot of work where the LLM speed up comes from helping you quickly search docs and codebases and double check your code, but handing the entire thing off to an LLM isn’t reasonable. These tasks aren’t going to reach this mythical 10X productivity boost that is genuinely achievable for much simpler work.

Zigurd•22 minutes ago
Some domains don't have the established regularity of architecture that it takes to achieve 10X efficiency. Two I can think of off the top of my head are embedded systems, with a variety of sensors, outputs, processing power, and memory, and novel protocols like ATProto, for which training data is thin on the ground.
dev_hugepages•24 minutes ago
Hey, could you share the prompt you're using for "teacher mode"?
gashad•about 1 hour ago
This reminds me of themes I recently saw in [Harness Engineering is not Enough: Why Software Factories Fail](https://www.youtube.com/watch?v=Ib5GBkD555M) (Warning: the last 3 slides seem like an advertisement). One thing I liked is how Dex has a little graphic he glossed over showing software development is

- 25% planning & aligning with other teams

- 25% coding

- 25% testing/verifying

- 25% code review/rework

One argument was that agentic coding speeds up that coding part a bunch. So maybe there's 2x speedup in coding. But that's only a small speedup in the totality of everything software engineers do.

whateveracct•about 1 hour ago
> So maybe there's 2x speedup in coding. But that's only a small speedup in the totality of everything software engineers do.

Amdahl's Law should be familiar to anyone with a 4y computer science/engineering degree. Why aren't they applying it to their own throughput?

steveBK123•about 1 hour ago
The other hard to measure part is that I see/hear a lot of LLM usage going towards dev work that was never prioritized before.

Suddenly devs who were cranking out features with no interest in infrastructure are attacking giant refactors to make the code more understandable to the LLM.

Other devs are using LLMs to build themselves quality of life SDLC tools completely separate from the core code base.

Plenty of other examples of this.

leoedin•about 1 hour ago
The quality of my bash scripts is 100x what they used to be. Proper help messages, flag parsing, functions, internal variables, using sed all the time (I could never wrap my head around that).

Of course, the main issue is that they’re completely undebbugable now. My bash scripts used to be a sequential list of commands, now they’re 500 lines of variable laden functions.

Is my life any better? Dunno. But it’s satisfying (until there’s a bug)

nasretdinov•44 minutes ago
> the main issue is that they’re completely undebbugable now

Well, that means the quality actually dropped then :). Looking impressive isn't equal to quality, understandability and reliability is

mckee_plus_plus•12 minutes ago
I switched to js for dev related scripting after seeing how much python scripting is used for portable c++ projects like chromium.

A node glob() or a regexp string.replace call is probably easier to read than spaghetti shell.

And your llm might do a much better job of creating clean, readable and testable code.

move-on-by•43 minutes ago
Just one more data point but this is what I’m seeing too. The extreme ‘ruthless’ prioritization has stopped and devs (who want it) have breathing room to make the enhancements they’ve been wanting all along. Turns out what is good for AI is also good for regular old school SDLC. All you have to do is say it will make AI more effective.
coffeebeqn•26 minutes ago
I use CC to do the testing and verifying in multiple deployment environments. It’s faster at things like coming up a plausible test payload or ten, querying a bunch of metrics from datadog, querying and verifying state from a db before and after testing, scanning all the deployed logs for relevant errors. For me that has been more of an uplift than the coding. I still feel like communication it’s worst at. So writing tickets, getting a decision out of a group, documenting only the important things, etc. it’s still not that good at
deergomoo•about 1 hour ago
> As for documentation, I've found this simple instruction to vastly improve LLMs' output:

> Never write READMEs, docstrings, or comments. I will write those myself later. And yes, I really mean this.

This is quite validating as I came to the exact same conclusion myself. We’re required to use an LLM for every task at work that touches code†, and I was really struggling to get Claude to stop with the long waffly comments that reiterate the next few lines of code in 3x as many characters, making contextless references to subtasks in whatever harness du jour we’re using this week.

No amount of examples or explanation of what I wanted would make it stop. And then I realised of course, I’m asking something which has no concept of meaning (or, indeed, anything) to only add meaningful comments. More fool me I guess.

Of course, it’s ultimately pointless given all of my colleagues are regularly opening PRs with more comments than code anyway. 80% of my code review responses these days are just increasingly exasperated “pointless comment, please remove”.

† This is just as infantilising as it sounds, by the way

openasocket•41 minutes ago
+10, I can't stand AI-generated comments. Half the time they are paragraph-length translations of every 5 lines of code into English prose, or just regurgitating whatever prompt they were given. When they actually try making high level comments they are worse than useless. It's really hard to put into words exactly why. It's something about how they are very verbose, but at the same time vague and stated in a slightly-off manner. Or they will introduce new terminology not reflected in the code's nomenclature, sometimes terms that are just synonyms for terms that the code already uses. Something about it makes me instantly distrustful of any information the comment may actually convey.
monknomo•37 minutes ago
locally correct and globally incoherent is how they seem to me. I, and a number of folks I have talked to, find some of them incomprehensible. Like each sentence makes sense, but the overall thing does not.
wannabe44•3 minutes ago
It's because they don't really have a mental model. RL with Verifiable Rewards can reward working code, but it can't tell you whether the prose make sense or not. In theory RLHF should be good with this. In practice, it appears to be a measure difficult to quantify and steer. I am not an insider though. So it's just a theory.
sync•about 1 hour ago
You can create a PostToolUse hook [0] which will automatically chastise Claude to shrink comments to one line. It's not perfect but better than the sea of prose it tends to generate by default. Bonus is that it would apply to your colleagues as well!

[0] https://github.com/chrisvariety/branch-fiction/blob/deb37f2b...

nevertoolate•about 1 hour ago
> We’re required to use an LLM for every task at work that touches code

Why not just write the code in the prompt so LLM can paste it.

troupo•about 1 hour ago
> Never write READMEs, docstrings, or comments.

I found that latest codes don't write comments in code by default. And when they do, they write stupid shit like "This was code that did X, it was now removed".

You have to explcitly prompt them to write comments in code. They are still useful for you, the user. But are arguably useful for the model, too, given how many of them (especially Claude) only reads small chunks of files. So I'd rather have code comments than it reproducing a picture from incomplete data.

wongarsu•2 minutes ago
A small mention in your user-wide Claude.md (or Agents.md or whatever you use) about the desired types of comments goes a long way. The typical "why, not what", clarifying larger-picture stuff, and everything else you find in every book on code quality
imoverclocked•about 1 hour ago
... the official return of pair programming! The best part: LLM's save you from having to argue with a human. Added bonus: now you get to master two tools instead of one.
iLoveOncall•about 1 hour ago
Even this is overstating it IMO.

I already convert from multipliers to percentage of increase, so when someone claims 10x they very likely mean +100% productivity, and here 2x means +20% productivity, which seems about right. Nobody that was normally productive before LLMs has suddenly 10x'ed their output now.

The problem is that 20% productivity when it comes to generating code, really doesn't translate in 20% productivity increase overall, when you take into account the fact that the code quality is worse, the fact that writing code is actually not the majority of your time spent, and that people get burnt out from the usage.

what_hn•about 1 hour ago
Does a 60x speedup count? Are you still copying and pasting from chatgpt, because if so your definitely doing it wrong.
forlorn_mammoth•about 1 hour ago
Wait, how about an infinite speedup? A friend of mine couldn't code, and now he can. So he is infinity-x better at coding thanks to LLMS!

Take that, you mere 10x-ers! Your days are toast!

dgellow•41 minutes ago
Left behind, as the infinite-x rockstar developer roars off on their motorbike, trailing a plume of dust behind
prmoustache•23 minutes ago
If 60x was a thing, we would see many fantastic products appearing on the market, every product would have improved or goten major new interesting features. Yet it hasn't really happened.
iLoveOncall•about 1 hour ago
[flagged]