If it Happens
I'm going to start off with a snippet of the conversation between Anthropic CEO Dario Amodei and investor Gavin Baker, from a few months ago.
I do agree that the public has a negative view of AI (and that this is a big problem), but I don’t think it is primarily caused by me or any other AI leader warning about AI’s risks. I think it is fundamentally a crisis of trust. I think that ordinary people don’t trust companies, governments, or the tech industry and always suspect that we are cooking up some new way to screw them over. The causes of this go back decades and AI is just the latest iteration of it. I don’t think that a glitzy marketing campaign with a positive spin (which some have advocated that Anthropic do) is the way to win back that trust — at this point, saying that AI will cure cancer is more a cliche than it is inspiring, and most people think it is deceptive. The thing that will work is actually curing cancer. I think by far the most accurate criticism of AI companies including Anthropic is that we haven’t yet delivered on our big promises to benefit the world.Because there's something important here that was somewhat glossed over, and it occurred to me in a recent discussion about generative automation. The companies don't have to deliver on their big promises. They pretty much never do.
When businesses, large or small, go to governments looking for some sort of subsidy (or when governments seek to entice businesses), the benefits, whether those are tax breaks, payment of construction costs or what have you, are pretty much always written into the contracts. If a group of City Council members in Someplace, USA agree that a data center will pay zero property taxes for some number of years, and angry residents vote them out and elect an entirely new city government, they're still stuck with that agreement, or with having to pay any exit costs that were written into it. It's just the nature of the beast. But if a business' claims of how many jobs will be created fall short, or they don't manage to create a cures for cancers, that's just how it is.
In effect, businesses request, and often receive, defined and binding contributions in exchange for aspirational public benefits.
And as a side effect of this, businesses often undermine existing potentials, so that they can repackage and sell them back to the public, while taking on no obligation to ever deliver on them. Consider Mr. Amodei's belief that "it will actually be possible to cure most human disease in ~5-10 years, as crazy as it may sound to ordinary people and frankly to biologists as well (I used to be one!)." This presupposes that no other technology will be able to deliver this benefit. Because if pre-LLM technology is capable of helping humanity create cures, then there's no need for the negatives that go along with building out datacenter infrastructure, for example. And because they have no real obligation to deliver the benefits they aspire to create, once those aspirations start to look unrealistic, they may simply be abandoned in favor of something more immediately profitable. And it's the public that loses out.
On the political side of the ledger, I think that "the system," as it were, relies on public inattention (and sometimes, forced ignorance) to the details of these agreements in order to facilitate these transactions. And while a lot of people are quick to point to self-dealing or other nefarious goals, I suspect that a lot of it comes down to the fact that American politicians are Americans themselves, and for many people in the United States, their "average" fellow citizen is an idiot who would block public goods simply out of culpable foolishness. And once one has concluded that the average person wouldn't know what's good for them if you hit them in the face with it, cutting them out of the process becomes laudable, if not necessary.
And this feeds into why people find the claims of technology companies deceptive; first, I would suspect that most people find the claims of nearly all companies deceptive, but secondly, if there's no penalty for never living up to the claim, why expect it to have been made in good faith? After all, the companies get what they wanted, and they didn't get to the point of having valuations will into the billions of dollars and more by giving away value when they don't have to.
