Understanding the controversy surrounding AI psychosis

Box founder Aaron Levy got us talking this week with a social media post suggesting that tech CEOs are “uniquely vulnerable to AI psychosis.”

In the latest episode of TechCrunch’s Equity podcast, Kirsten Korosik, Sean O’Kane, and I did our best to explain Levy’s comment. For one thing, we note that he does not disavow AI tools, but merely insists that CEOs actually need them is used Those tools to understand.

This is a relatively mild note of skepticism compared to other signs of a broader backlash, whether you look at graduating college students booing any mention of AI, the bad vibes around layoffs in the tech industry, or the apparent increase in installs on the DuckDuckGo search engine after Google announced it was bringing more AI into the search experience.

Kirsten suggested that Google faces a dilemma where it’s “chasing this thing that it seems like it has to do to keep up, but it’s messing with the thing that people associate most with the brand, and it’s not improving it.” More broadly, she wondered “if this anti-AI moment represents an opportunity for startups or other areas of business.”

Keep reading for a preview of our conversation, which has been edited for length and clarity.

Anthony Ha: AI is incredibly polarizing. And that’s part of what’s so hard to talk about, you can feel a little crazy because [simultaneously,] Everyone uses it and everyone loves it, but also no one uses it and everyone hates it at the same time. There are large groups for whom both apply.

On the user side, one thing that was very striking is that we [already] I talked about Google Ads around search and how AI is becoming a bigger part of search – although it would have been interesting to see how Google has tried to step back from that a little bit, or at least add some nuance in terms of, if you want to try the 10 blue links, there are still ways you can get it. It won’t go away completely.

But I think a lot of people aren’t excited about the direction Google is headed. And so you see, for example, DuckDuckGo said installs were up 30%, which is a huge jump. Now, of course, DuckDuckGo is a much smaller product than Google. I don’t think Google has any immediate problem, but I think this is a sign of a very large audience that doesn’t like the current direction of AI.

Sean O’Kane: I will say one thing that I keep looking for when I look at all the leading AI labs or technology companies that are really pushing AI features and products — to me, there just seems to be this collapse toward an anthropocentric approach, this idea of ​​trying to understand what you want to offer people and sticking to that.

And Google is one of the companies that I would say is still pushing in the other direction. They’re trying to do a lot of different things, but they’re not doing themselves any favors by being vague about it.

What I mean by that is that when Google gets on stage at IO and talks about how they think they’re going to change search, a lot of what they talk about, they talk about shopping or things that end in a commerce transaction. And I think a lot of what we think about Google collectively, especially people who have been using it for two or three decades, is as an information retrieval system.

Google can struggle a lot with that, where they have reactive concerns about how it’s ruining the information retrieval side of things, and they’re like, “Yes, but this will still be there. Let’s focus on how this will help you book a flight or something.”

Then they also go out and shoot themselves in the foot by launching them – stress testing these systems must be very difficult, but they go out and launch these things and they run into the same problems they’ve had for years.

Kirsten Korosek: We had a great article just published about Google not knowing how to spell its name. If you ask him, “How many P’s are there in Google?” You say two.

It’s this tension between: Google is going after this thing it feels it has to do to keep up, but it’s messing with the thing that people associate most with the brand, and it’s not improving it.

What I’m wondering is that we’ve already seen some early evidence of people’s fingers voting or walking for them, by literally going to another service. But I wonder if there are opportunities for other startups or culturally, if this anti-AI moment is an opportunity for startups or other areas of business that we haven’t really thought about.

Anthony: definitely. Again, this can be a challenge because there is a wide range of opinions. And if you build something specifically designed for a skeptical group [of] Artificial Intelligence, you will likely alienate other users who are more evangelistic or enthusiastic about the topic. But I think this is the moment we live in.

And you can see how DuckDuckGo is promoting itself, they’re putting a lot of emphasis on this anti-AI idea, which I find very striking because I mentioned it before, [I’ve been] Stay away from Google myself, and try other search engines. And I would say that a year ago, when I started this exploration, even these alternative search engines were still trying out AI features, focusing on AI to some extent because they also thought they had to do it.

And now I think they’re seeing that there’s actually a path that should be like, “No, we’re not interested in this stuff at all. Or as much as we do that, we put it in a separate sandbox that won’t impact your core search experience.”

Kirsten: I think we sometimes unfairly categorize all tech CEOs as feeding people AI. And there’s at least one tech CEO who came out and said, “I think there’s a little bit of psychosis among other tech CEOs about AI.”

I’m talking about the founder of Box, Aaron Levy, who has come to Disrupt a few times and is definitely a friend of TechCrunch. He made these comments about how CEOs are uniquely vulnerable to AI psychosis because, as I’m reading this, they are “far enough removed from the last mile of the business that remains to be achieved to generate the most value with AI.”

I thought this was really interesting. And I wonder if there are other CEOs who agree with that. I also wonder, as part of this shift in thinking about what needs to happen to generate the most value, if they’re also thinking about how their workforce is changing, which is our other topic today – [not] It’s not just about segmentation of AI, but also about how AI is changing business. And we’ve seen, certainly, some of the bad news in that, which is a lot of layoffs.

But I also think we’re seeing big changes in how people work. I’m wondering in the areas that you cover, if you see evidence of that, because I don’t think it’s just the “AI startup sector” or the big tech companies.

Shawn: As far as the companies I cover, many of them tend to operate on things adjacent to them, if not physical transportation. It seemed much slower than it is, unsurprisingly, on the software side of things.

We’re starting to see some of that change. We talked on the show a little bit about Mind Robotics, which is a clone of Rivian CEO RJ Scaringe. And, you know, there’s definitely more AI being applied to physical infrastructure, manufacturing, robotics, and autonomous driving.

I think the software side is where things really change, where you have people whose job is directly related to producing the code.

Anthony: I think part of the question, [involves] Adopting AI in companies and then laying off workers due to AI – to what extent is this top-down or bottom-up?

Because I think a lot of the other workforce transformations in the last couple of decades have been at least, to some extent, bottom-up: These are the tools that people actually like to use, they bring them, and then at a certain point, CEOs and IT managers accept that.

There is some feeling that it is too much [belief that there are going to be these] AI productivity gains seem to be embraced by executives — or, if you’re at a startup, potentially by the venture capitalists funding you — who love this dream that you can just have a small team and be as effective as a company with a much larger team.

And I don’t think that’s necessarily impossible, but I think Aaron’s point is basically that if you’re not close to completing any final work, how will you know? He’s also not someone who says we should get rid of all AI tools, but he says you should actually use these tools and understand what they’re doing. You can’t look at a slide and say, “Oh yeah, amazing efficiency, let’s go.”

Kirsten: Well, I think there’s a lot of real evidence that these companies are using these tools, and they’re directly impacting workers in the form of layoffs, as well as the way they work. Both facts are accurate here.