Shortfall

Many of the negative consequences of consumer AI usage are caused by loneliness, isolation and gullibility.

Seth Godin. "AI together."

I would disagree with this, somewhat. Or maybe I would simply re-frame it. What I think are at work in cases of "AI Psychosis" and similar technologically-driven maladies are simple unmet needs. And part of what generative automation strike so many people as "sycophantic" is that it's designed to meet user needs. And like a lot of consumer products, it's not designed to care precisely how it does that.

People are always sensitive to their unmet needs; although perhaps "driven by" would be a better way to put it. And one of the aspects of American culture that people are constantly pointing out is its tendency towards individuality. And this means that people are less likely than one might want them to be sensitive, and responsive, to the needs of people around them.

And into that deficit steps generative automation. And people who can't find enough connection, community or validation from the people around them now have a ready source; and one that never becomes tired, impatient or needy itself. Why would anyone expect that people wouldn't cling to that? If they'd met a person with those traits, they'd be considered foolish to not hold on to them for dear life.

So I'm not sure that trying to steer generative automation in a direction where it doesn't meet those people's needs either is really the best way to go. Even if it is much easier than changing our society, and it's response to people.