What happens if we build it and nobody dies?

Excerpt: "This will require, in many ways, becoming like the Amish. The Amish don’t actually ban technology; what they do is use a community-wide process to determine whether a new technology is good or bad for their aims. It is easy to imagine lots of communities might find themselves doing the same thing. In fact, the intense, passionate anger at an indie game team for using an AI tool to debug a tiny section of their game suggests that many already do.
I don’t want my community to shun people for AI use, but I do expect we’ll draw the line somewhere. I can already see those taboos emerging when I ask my friends where they draw the line: no recording casual conversations, no concealing who wrote something, no algorithmic feeds. It will take intentionality, but we can take up what is good for us and leave what isn’t.
As for the fear that ambition and hard work cannot coexist with a world without meaningful work to be done, I find some solace in my children at the same time as I fear for their futures. Their lives are already post-scarcity; they need not labor. And yet they do not strike me as without ambition or without the willingness to work hard. Among adult societies of aristocrats, perhaps, idleness turns to pathological zero-sum status games, but it doesn’t seem to do that in eight-year-olds. More resources just make their games more ambitious; they fight less when wandering off to do something else is an option.
I worry about how we’ll protect them from a world in which everything is meaningless, but maybe the answer is that they, having already solved that, will protect us."
