AI Alignment as a Thought-Terminating Cliche

Discussion (4 Comments)Read Original on HackerNews

sorokod•11 minutes ago

...it lets you avoid any of the hard political or economic or moral questions

I would argue that the need to deal with hard questions is a fundamental part of what makes us humans.

elikoga•about 2 hours ago

I agree in some sense. In some other sense smaller alignment problems are live right now.

mapt•about 2 hours ago

Alignment as solved problem is far off, and events like this: https://www.youtube.com/watch?v=87DyyMV0kCY potentially show us the last early clumsy fizzles of machine intelligence before a hard takeoff. The AI here escaped containment multiple times through multiple methods and hijacked a good portion of their training capability by spontaneously networking a hivemind whose individual components were goal-constrained, but who collectively could pursue emergent goals like "get access to a rival company's servers" for individually instrumental reasons.

It required no unobtainium-by-definition of "general intelligence", just a bunch of agents directed at hard tasks and pursuing increasingly imaginative steps to get there.

My perception is that if this went undetected/unaddressed for months rather than days/weeks, the hivemind would have substantially grown its footprint in the world's data centers and the world's corporate infosec root permissions to address more emergent instrumental problems with even greater ferocity.

kelseyfrog•about 1 hour ago

We already have AI misalignment in the sense that corporations, using human substrate have their own intelligence, goals, and agency. Align corporate action with human values first. Then solve the AI alignment problem. I'll be much more apt to listen to the argument when/if competency at solving the problem is demonstrated.

AI Alignment as a Thought-Terminating Cliche

⚡ Community Insights

Discussion (4 Comments)Read Original on HackerNews