Pivot to AI safety, I beg you

GPerson•about 4 hours ago

The reason I don’t pivot into AI safety (in a topic I might have comparative advantage in as a mathematician) is the following.

(1) I believe increasing AI capability is a net negative.

(2) AI capability is limited by AI safety in the way the power of a rifle is limited by how safe it is to use.

I.e., AI safety and AI capability look like two sides of a coin to me.

If I were disillusioned of this view I might consider it. But right now it just seems unethical and against my fundamental beliefs.

doitLP•about 3 hours ago

> AI capability is limited by AI safety in the way the power of a rifle is limited by how safe it is to use

But merely making it safe to use still prevents unnecessary death. And advocacy against rifles in general, or general gun safety is a viable path to limiting the negative outcomes.

Rifles are banned in many places on Earth and they also backfire and misfire less than they used to.

Even so, you can do the simple "call your representative" and "hand out fliers" and "talk to people about how AI is net negative" with no cost to yourself and it absolutely aligns with your fundamental beliefs, right?

GPerson•34 minutes ago

This is true. Really what I had in mind was research in AI interpretability.

rogerkirkness•about 4 hours ago

I feel similarly right now, which is patr of why I shut down my company.

LoganDark•about 3 hours ago

honestly I'm not sure a lack of safety has been stopping anyone. I suspect it's caused a lot of m̶a̶r̶k̶e̶t̶i̶n̶g̶ problems lately.

K0balt•about 2 hours ago

I’ve decided that the third Industrial Revolution is a foregone conclusion, so I’ve pivoted to try to make it better for everybody, not just corporations and governments. If we do it right, at least we will get a new washing machine* out of it.

I also think our work will help to underpin safety, and that actually a big deal, because as it turns out safety isn’t a bolt-on. It must be something resembling character, or it will be discarded in the same way that humans set rules aside when the calculus seems to support doing so under the governing incentive framework.

What I amo doing may slightly accelerate the process, but if I don’t succeed there is a much higher probability of having robots that are not generally useful to humans as a type, and will be completely captured by industry as subscription units, surveillance devices, and in general something that companies can use to harvest resources from you rather than a device you own that delivers all of it’s potential value to you as the owner.

*silent killers of human misery since 1937

with•about 4 hours ago

> We will need MILLIONS of people in the field.

it's a real issue but I'm not sure it's the mass mobilization problem the article makes it out to be. pretty sure it's growing extremely fast, and it's a new field in general. the models will keep growing in capability because of human game theory (I need to make my model better because my competitors are). it's not practical to expect millions in headcount to move from frontier capability research to safety

ilc_genesis_01•about 4 hours ago

The saying is, "you can't prove a negative" - mostly true, but really the issue is that with such a wide open future of possibilities for AI and safe (or unsafe) outcomes, there's an empirical issue of it being very hard or impossible to disprove things that are still hidden (haven't happened yet). Humans are maximizers in that we try to spend the least amount of effort when we're not sure what will happen, but after something bad happens, we'll act quickly to address that specific issue. It'll probably take a lot of small and large issues to happen for people to build up their societal "safety protocol" around the technology over time.

AuthAuth•about 3 hours ago

AI Safety seems like an activst job. I just dont care to much about AI "safety".

Pivot to AI safety, I beg you

⚡ Community Insights

Discussion (9 Comments)Read Original on HackerNews