Dario Amodei on Concentration of Power

I have no love for Amodei (or any of the other AI magnates), but I am concerned by the allure of handwaving away all his points due to his hubris and arrogance. Make no mistake, even this post is mired in it, but the fundamentals of what he is saying will need to ultimately be reckoned with.

The real problem is that, structurally, he has totally misaligned incentives. You cannot be for the common good when you are valued at 892 billion and have taken 100-200 billion of investor funds. And even if, by some stroke of sheer heroism, you are, you will simply be removed as chief executor and replaced with someone that is not. The only hope here is that they can somehow thread the needle where the growth is so substantive that somehow everyone wins. I think that is an exceedingly unlikely scenario.