What 370,000 College Essays Tell Us About A.I.’s Effects on Creativity

I’ve recently drawn a sharp line in the sand: no A.I. for writing. I’m not talking about expense reports or routine emails. I mean actual writing, and the creative brainstorming that precedes it to explore different perspectives or develop novel insights.

Excerpt: "Increasingly, many people I talk to — from students to teachers to peers — tell me that they think it’s OK to use A.I. chatbots for brainstorming as long as they do the “real work” of writing.

But this misunderstands something critical: Brainstorming is the work that’s fundamental to writing.

....For the past eight years, the Georgetown University neuroscientist Adam Green has been leading a national research team tracking the range of novel ideas that college-bound high school students present in their application essays, before and after the introduction of ChatGPT. In one study, he and his team examined personal statements from more than 370,000 students, and found that after ChatGPT became available, their essays suddenly used diverse and colorful language, but lacked truly creative ideas. And the linguistic coverup worked; post-ChatGPT essays were rated as more “creative” by human judges, even if the substance of the essays trod familiar territory.

In a separate study, the team found that human-written essays offered up to eight times more new ideas than those produced by A.I.

Another experiment run by a different research team compared short stories written by humans to those written with A.I. assistance. As with the student essays in Dr. Green’s study, A.I.-assisted works had more interesting vocabulary and were rated more enjoyable to read, but the underlying story lines were more homogeneous. Distinctive and offbeat ideas — with surprising characters or unusual settings — are often shunted to the side when A.I. is involved."