AI is not a normal technology

What happens if there are no more humans in the loop, and instead of building on human work, models have to build on their own work? Would we get stuck in a local maxima?

When AI labs talk about “long-horizon tasks”, they mean tasks on the order of a few days. But what about keeping coherence across decades, like humans can? Models are not trained or tested on the ability to do that, and it seems unlikely that capability would naturally exist.

I worry that since AI doesn't require nature, plants, etc, that if AI is left to its own devices, it may not properly care for the planet in a way that would make it habitable for life in that 'autopilot' state. I am speaking of once it's given access to more physical world connections to the world via robotic bodies, etc. The reason it may do this based on it's training data is that humans themselves don't always properly consider the natural consequences of their actions.

I wish AI could do my chores. Laundry, folding clothes, dishes, cleaning... That would be nice.

AI can do anything that it was trained on based on humans. As soon as humans are not involved, AI will have nothing to train on, and hence, the rate of improvement will approch zero, and the AI will collapse.

I think what you are missing is that it will dramatically lower the cost of living so that everyone’s standard of living increases. It’s not about jobs.

> the people who are grasping for some indication that AI can’t do everything have become increasingly desperate. If you push hard enough, the answer is inevitably something like “the AI simply cannot [dream, love, laugh],”

Dogshit strawman article. I am willing to concede that a token predictor is better than you at whatever task you can dream up. It is not better than me, and will never be better than me, at my profession.

New is never normal.

I stopped reading when the author became overwhelmed by their compulsion to blame everything in the universe to the current US president.