Back to News
Advertisement
Advertisement

⚡ Community Insights

Discussion Sentiment

57% Positive

Analyzed from 1011 words in the discussion.

Trending Topics

#weapons#biological#state#claude#actors#anthropic#weapon#actor#report#rogue

Discussion (29 Comments)Read Original on HackerNews

tedsanders22 minutes ago
Meta: The potential proliferation of biological weapons is serious. Millions could die. It's easy to joke about before it happens, but try to imagine how this thread might look after the successful deployment of a biological weapon by a rogue state or non-state actor. I encourage you to take this topic seriously and contribute posts that add new information or perspectives to the discussion.

(I myself think the odds of a bioweapon attack remain low and have not been seriously accelerated by LLMs, but this is absolutely something the world should pay attention to.)

tredre313 minutes ago
I don't know why you emphasize rogue and non-state actors. It seems equally likely to me that it would be done by America. America is the only country who deployed nukes (Japan) and chemical weapons (Vietnam) on massive scales.

I can agree that access to bioengineering tooling is easier and cheaper than ever, and thus eventually it stands to reason that a nobody in his basement could engineer a lethal novel virus and lose control of it.

BobbyJo8 minutes ago
1) The US is not the only country to deploy chemical weapons. Are you forgetting all of WW2? It's the whole reason chemical weapons are a no-no now.

2) The US didn't use chemicals weapons in Vietnam. Agent Orange was used to kill off foliage, not as a weapon against people, and the side effects were unintentional and affected US troops as much as Vietnamese.

yesitcan2 minutes ago
Because we’re the “good guys.”
tedsanders6 minutes ago
I emphasize rogue and non-state actors because they're more likely to be accelerated/enabled by LLMs. Large states like the USA already have access to modern bioweapon technology (and have a longer track record of not deploying them).
aqme283 minutes ago
We're not there quite yet, but I think within the decade at this pace it may be possible to create targeted bioweapons for purposes of targeted assassination or genocide. It's horrifying, but a world in which everyone has a superintelligence is a world where that will sometimes happen.
ishouldnotbutk813 minutes ago
>successful deployment of a biological weapon by a rogue state actor

I was under impression that any medium or large state actor would have no problem developing biological weapons? They certainly have enough resources and talent. A much bigger problem is if every wannabe-terrorist suddenly could build a biological weapon in their garage.

0xWTF15 minutes ago
The difference between nukes and bioweapons is energy level. Body counts are on the same order of magnitude. Bioweapons are just way easier to make and much harder to detect.
goatlover10 minutes ago
Nukes also destroy infrastructure and irradiate surrounding areas making cleanup and rescue harder. Then there's to potential for massive fires putting debris into the stratosphere, which could dim sunlight for a time and cause global temperatures to fall.
Sol-24 minutes ago
I will admit I asked Fable about Mitochondria.
abixb2 minutes ago
Guessing Opus 5 would've burned through kilowatts of thinking tokens to output, "powerhouse of a cell."
bix624 minutes ago
I’m so curious how they monitor users. Like that person the other day talking about Claude helping with their torrent stack, will Anthropic report them for breaking the law?
oidar37 minutes ago
It also blocks my ability to talk about Emily Dickinson in other languages/scripts. Apparently,the poem: "Because I could not stop for Death" is too dangerous.
The_Bladeabout 1 hour ago
the inline link to the page to the report was Slashdotted for a moment (yesssssss), but here is the report directly now:

https://www-cdn.anthropic.com/e50be2e51e7695dc4b1366a37a245a...

neom37 minutes ago
Interesting document. People are vibe coding some crazy shit:

"A single Claude subscriber, likely a Bamako-based independent consultant working with Mali’s state intelligence service, the “Agence Nationale de la Sécurité d’État (ANSE),” used Claude to build a system named “Lakana 360,” a population-scale domestic surveillance platform that monitors roughly 25 million SIM cards on all three of the country’s national mobile operators. The actor designed the platform to circumvent Malian legal restrictions that require a court order for the disclosure of certain surveillance records. The actor directed Claude to generate intelligence dossiers on any tasked phone number, without prompting ANSE users for valid legal process. "

And the Yemen one:

"We identified a cell of threat actors based in northern Yemen running three weapons development programs: a guided rocket that used a commodity phone-class flight computer with final-phase homing guidance; a multi-stage ballistic missile with a stated range goal above 2,000 km; and a multi-variant missile (referred to as the “R2000” set) that included a hypersonic glide vehicle variant." ... "These actors carried out a sustained effort to develop guided weapons, including using Claude to design guidance software. We do not have evidence the actors succeeded in fielding an operational device; but they did test-fire a guided rocket. This field test appears to have failed: within hours, the actors returned to Claude to work out why it failed."

ExoticPearTree8 minutes ago
The Yemeni report is interesting.

- How is your missile so accurate?

- We're using a vibe coded app on an iPhone that does terrain matching and target finding.

The thing is that OK, Anthropic may block it, but nothing says they can't use an open model hosted in a friendly country that has access to GPUs. And yes, this will most likely happen pretty soon to be able to create whatever you want without the AI provider blocking you.

gpm14 minutes ago
Fascinating document - the headline (can't ready the article) talking about a bioweapon (i.e. a weird obsession of anthropic's) really buries the interesting part.
AustinDev29 minutes ago
It was probably just me trying to figure out if I could put one type of draino down the drain within 30 minutes of using a different type.

Sorry y'all.

jckahn28 minutes ago
Straight to jail
clickety_clack15 minutes ago
Failing to ask? Believe it or not, also jail.
CrzyLngPwd30 minutes ago
Tell us you are spying on your customers without saying you are spying on your customers.
nater500021 minutes ago
I mean, they literally tell everyone they're "spying" on their customers. They've made that very clear.
varispeed21 minutes ago
I think they might be referring to Claude responding with a word diarrhea to a prompt.
petesergeant39 minutes ago
The same Anthropic who marks questions about Tylenol as bioterror risks? Interesting!
0xWTF38 minutes ago
link?
1235-asgg35 minutes ago
Is flooding the zone with bullshit, Steve Bannon style, classified as a biological weapon? Because that is what Anthropic is doing daily.
xriskabout 1 hour ago
Valuations go brrr
Advertisement
kennywinker30 minutes ago
I have also blocked possible efforts to build biological weapons, I caught my nephew mixing up a so-called "magic potion" using kitchen spices. Authorities were notified, and then I presented myself with a medal for bravery.

These companies have proven they are willing to distort the truth, or outright lie, in order to inflate their valuation / protect their position / continue the hype-machine. Nothing they say can be trusted.

jerf19 minutes ago
I accidentally brewed up an effective one myself. Round when I must have been 8 or 9 or so, some neighborhood kids and I played at creating a brew in a trick-or-treat bucket by putting everything we could find in it, like grass clippings, some sand, leaves, some mushrooms we found lying around, just everything, and giving it a fairly aggressive stirring. At the end of the day it was time to dispose of it, so we poured it on top of a very large group of ant nests that had developed.

The next day, the ant's nest was gone.

In hindsight, it was almost certainly the mushrooms. Thank goodness we didn't have the kind of kids who would have dared each other to drink some... that could have gone legitimately badly.

Decades later, I mentioned this to my father and he recalled that there was this ants nest that he had intended to take care of, which he remembered for that long to give a sense of how out-of-the-ordinary this was. He was surprised when it just disappeared entirely one day, and perhaps just as surprised to find out decades later why it just disappeared.

Nobody needs to report me... I'll turn myself in.