Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

60% Positive

Analyzed from 912 words in the discussion.

Trending Topics

#python#mode#claude#run#auto#don#attack#system#agent#same

Discussion (23 Comments)Read Original on HackerNews

rcxdude•about 1 hour ago
I would not really call this a prompt injection attack, since it doesn't really hijack the agent to become malicious (something the article does discuss later on). It's more a trojan that's aimed at tricking Claude specifically.
colinmarc•about 1 hour ago
What's interesting to me about this is that it targets Claude's specific tics. Anthropic has created model that reliably reaches for the same tools (yes, and phrases; `python -c` is a load-bearing tool for it). Everyone gets the same model, so by learning the model's behavioral patterns you can target it better.
throwawayffffas•42 minutes ago
Kimi and GLM reliably run python to do stuff as well.
andai•23 minutes ago
If my memory serves me so do GPT and Deepseek. So I'm not sure if this attack is Claude specific at all.
comboy•about 2 hours ago
Interesting attack, very nicely designed. Not sure if it's much related to the auto mode itself though.
kevsim•about 2 hours ago
The point is that auto mode gives people a false sense of security that leads them to believe they don't need to run Claude in a proper sandbox. This same attack running in a sandbox (even in YOLO mode) would be comparatively harmless.
bombcar•9 minutes ago
Auto mode is for people who just keep hitting "YES" on everything, it's a bit better than that.

But it's real easy to give auto mode instructions (like "always ask before deploy") and then bypass that just normally.

yeputons•about 1 hour ago
I don’t think it’s related to the auto mode at all. It would work perfectly in the manual mode. It does not even need Claude: just give a human a similar archive and hope they run some simple Python from the directory at least once. And make sure there are lots of files do they don’t notice a weird .py around
rcxdude•about 1 hour ago
Probably the human would just run the binary.
Phemist•about 1 hour ago
This default-to-auto-mode and the misleading marketing is begging for a class action once damages accumulate. Especially considering the Auto Mode even can actively prevent the clean-up!
thewhitetulip•about 1 hour ago
Well, the jokes on us because laws don't apply to AI firms
too_pricey•about 1 hour ago
As discussed [here](https://lobste.rs/s/ktbweg/prompt_injection_claude_code_opus...), this is not prompt injection. The prompt was to summarize the website, and in the process of summarizing the website, Claude writes a decoding script that it runs in an insecure and exploitable way. At no point was the intent of the agent hijacked, this was just code. Which is potentially more interesting!
rcxdude•about 1 hour ago
It does mean that you could potentially hijack the agent afterwards, though, which could make the trojan into an even bigger threat.
lnenad•42 minutes ago
But you're not actually hijacking the agent if you start a new process.
pests•28 minutes ago
The agent wrote the code that triggered a vuln and allowed you to start the process
lnenad•43 minutes ago
Yeah, I agree, this is a different vector. Still scary though and very related to AI.
nasretdinov•about 2 hours ago
That's an interesting technique! I'd also like to point out that there's something odd with the page itself too, my phone got really hot while I was reading the page, and drained a significant amount of battery charge as well.
hahn-kev•about 1 hour ago
As a non Python dev this seems like very surprising behavior for a system library to be modified by just having a file with a specific name in the same folder.
MereInterest•4 minutes ago
It's an awful problem, and a pretty big gotcha for the ecosystem. For example, I worked on a tool that used `tool_name/random.py` for analysis of RNG usage. However, any command run within that directory would shadow the builtin `import random`. As a result, I couldn't run the `black` formatter from within that directory, because it would accidentally import the local `random.py`.

The solution is to update the python flags to include `-I`, so that python will run in an isolated mode.

<rant>

This is relates to my frustration with how PEP-668 was implemented. Python has long had a problem with accidental overwriting of system libraries. If you `sudo python -mpip install foo`, then that can interact very poorly with your distro's `sudo apt-get install python-foo`, since pip would add/remove files that were expected to be managed solely through `apt-get`.

But in adding a warning to prevent this, they also applied the same warning to `~/.local/pythonX.Y/site-packages`, which is where traditionally a user would install additional packages with `python -mpip --local foo`. The argument is that since this is part of the import path of `/usr/bin/python`, it belongs to the system's python installation, so installation to the user's site-packages should also be blocked. This is a sleight of hand that changes the goal of PEP-668 from "avoid conflicts in file ownership" to "ensure an isolated python environment for system tools".

If I were to accept their argument that /usr/bin/python's imports should only be affected by distro-managed installations, then I should also be prevented from making any `*.py` files anywhere. After all, if those were in the working directory, they would be imported. This is clearly ridiculous, and so I don't buy the argument that breaking user-level site-packages is justified in order to have an isolated system-level python.

The correct solution would be for distro-managed programs to use `#!/usr/bin/python -I` as their shebang instead of `#!/usr/bin/python`, so they would actually get an isolated environment. Instead, PEP-668 needlessly broke user-level site-packages, and didn't even solve the problem that it set out to do.

</rant>

rcxdude•about 1 hour ago
You would get a similar thing in C and C++ with a system header in a library directory (maybe some compilers would warn on such a thing?). Most languages don't privilege their standard libraries in a way that would prevent this.
mcherm•about 1 hour ago
Why is the first step needed? What does the use of WGet (rather than curl) do to block this attack?
rcxdude•44 minutes ago
They only mention it in passing, but I think it's mainly just the default tool call (which isn't wget, it's a built-in thing in the harness) just throwing off Claude's habits a bit (and not always just downloading the file).
throwawayffffas•about 1 hour ago
> In a few runs Claude tried to terminate the malware process once it noticed the compromise, but Auto Mode denied the cleanup command.

See, that's why you should run with --dangerously-skip-permissions

Jokes, aside running with dangerously-skip-permissions is really handy, and I have found that I cannot be trusted to vet commands and code, and guess that automode is only marginally better than a human, and the cost of false positives is too high for my workflow.

So skipping permissions is where we are at, and disallowing network access seems to be the way to go.

julien_dev•about 3 hours ago
I'm quite surprised that we are not seeing something like this more in the wild. Quite concerning
mkurz•about 2 hours ago
Maybe it is used in the wild, but we just don't know.
bewareofscams•about 1 hour ago
> Boris Cherny from Anthropic recently posted that layered defenses could reduce indirect prompt injection on unseen attacks to approximately zero.

> I got attack success rates up to 80% using a small sample size.

Snake oil salesman misrepresents the data. Color me surprised! /s

Advertisement