AI as a Mirror, Not a Replacement: Kim Carson on Purpose, Vulnerability, and Creativity

Open on YouTube ↗
Overview

Kim Carson, introduced at The Interval at Long Now as an "AI creativity evangelist," built this talk around one question: what if AI is not here to replace us, but to remind us who we actually are? Carson's position is that AI's value lies less in automating labor than in reflecting us back to ourselves. Used that way, it can push people toward the creative, relational, and imaginative capacities that Carson considers most human. The talk moved from a personal anecdote through Carson's early AI career, then to arguments about vulnerability, compassion, and design, and ended with practical advice and an audience Q&A.

20 min read

The Experiment That Came Back Unchanged

The central question came to Carson about a year before the talk, while working with a custom GPT the speaker calls "Kim GPT." Carson recommended everyone build one, calling it "a way to talk to yourself without talking to yourself."

Carson was writing a blog post to set an intention for 2024. The theme was integration. Carson had long worn many hats (mom, friend, CEO) and had never brought those worlds together, so the goal for the year was to unite the personal and the professional. Carson described the piece as deeply personal and emotional, written longhand during a period with a lot going on.

Carson fed the draft to Kim GPT and asked it to clean up the writing and suggest improvements. The model returned the text exactly as written. Assuming a glitch, Carson tried again and got the same result: no added commas, none of the em dashes or stray bullet points such models usually insert, nothing changed at all.

Carson took this as a revelation. When the subject was Carson's own self, the AI could not say what Carson wanted to say. It behaved more like a mirror, reflecting what it knew, but it could not supply insight into Carson's own humanity. Carson had to do that part. As Carson put it, while they were prompting the AI, the AI was in effect prompting them back: who are you, what do you want to say, what do you want to do in the world? That experience became a catalyst for rethinking purpose, both personally and for humanity more broadly.

Starting in AI Through Social Impact

Carson described themself as an "AI OG," having started a decade earlier at IBM Watson. Joking that a decade doesn't count as long ago among Long Now people, Carson offered a new moniker: "the Oprah of AI."

Carson felt lucky to have entered AI through social impact rather than efficiency or optimization. The job at Watson was to stand up Watson Education, a teacher companion for teachers in underserved schools. These teachers might have 40 or 50 students in a classroom. The system aggregated data about the students and the areas they lived in, then generated personalized learning pathways. Carson noted this was "social impact" before that label was common.

This shaped Carson's view of what AI is for. The questions were how the technology could help with humanity's "biggest, hairiest, most audacious, wicked" problems, and how it might help people think about what makes them human, not just write marketing copy. Carson stressed that this was before hyperscalers and before ChatGPT.

What Machines Can't Do Yet

That early work convinced Carson that "we still hold the mysteries." For the last one or two hundred years, Carson argued, society has defined human purpose around cognition, productivity, and value creation, meaning what we can provide to or consume from the world. Carson questioned whether that is really what makes us human.

In Carson's view, machines right now cannot feel, intuit, yearn, love, long, or commune, and these may be the truly human qualities. Carson's hope is that the technology can act as a catalyst toward those qualities, letting humanity serve as the compass for what we actually want to do.

Technology Begins With Imagination

Carson, dressed in sci-fi style and a fan of both Star Wars and Star Trek, argued that many things we take for granted were first dreamed up in art and culture before being built in a lab. The example given was Captain Kirk having an iPad in the original Star Trek. Most innovations, Carson said, are born from creativity and imagination.

Carson is worried that we have forgotten this. For the past 10 to 15 years, Carson said, most art has focused on dystopian and horrible things. If the Star Trek pattern holds and art prefigures technology, "we're in a lot of trouble." If artists aren't imagining ways to make humanity better, Carson said, "we're doomed," and that shouldn't be acceptable to anyone. The goal, as Carson framed it, is to move from forgetting back to remembering.

Creativity Can't Be Optimized

Carson said AI is scaling faster than regulation and faster than our capacity for reflection. Creativity, by contrast, cannot be optimized or sped up. Carson called it "sacred" and core to humanity: the way humans draw together things that don't obviously fit, a process that is nonlinear, slow, and time-consuming.

So the question Carson posed is how to stop, reflect, and make real space for creativity during hyperscaling. Carson framed honoring creativity as reclaiming agency. When things move beyond our control, pausing to reflect and create deepens our sense of purpose. Carson pointed to the "underground" the host had mentioned, where people build things to connect and to love, and asked what happens when technology is built from a place of love. "Humans are dreamers," Carson said, "we're not just designers." We can fall into "in-between spaces."

Vulnerability as the Gateway to Innovation

Drawing on Brené Brown, Carson argued that vulnerability is the gateway to innovation. To tap back into creativity, we need vulnerable leaders. Creativity comes from approaching your fears, from feeling "that thing in your stomach that doesn't feel right" and moving toward it. Carson cited a friend's saying that in your dreams you can always slay the approaching dragon, and that facing it makes you a better person on the other side.

Carson imagined leaders who are deeply vulnerable, brave, and acting from "heart-centered" courage, and asked how much more creativity the world might see as a result. Carson called this "love-centered building," using vulnerability as a design principle to expand what's possible.

Against Human-Centered Design

Carson said directly that they are "not a fan" of human-centered design. The reasoning: centering humans separates us from everything else, and that separation has caused many current problems. Separation from the environment leads to climate change. Separation from each other leads to harm and to things like nationalism, "things that might be on the news."

What Carson wants to champion instead is vulnerability and creativity as design principles that put humans back into an ecosystem they were always part of. Humans have a specialized, evolving role in it, but they are not the only thing in it.

Carson connected this to a recent retreat on embodied AI centered on human connection. The best creativity there, Carson reported, came from people willing to connect and play with each other. Recalling a longtime refrain, "what happened to recess?", Carson argued that play should be part of how we build. Reintegrating into the ecosystem, in Carson's framing, lets us answer what makes us human and perhaps build a future that is neither dystopian nor utopian but "protopian."

AI Cannot Tell You Your Purpose

Carson spoke about young people, including Carson's own kids, who are digital natives and might assume they can ask Claude, Gemini, or ChatGPT what to do with their lives. Returning to the blog-writing episode, Carson said AI can only reflect back what it has already seen.

That doesn't make it useless for this question. Carson described their own career as a "career portfolio" rather than a path, with "tours of duty" across academia, industry, and startups. Creativity came from merging the technical with the humanistic and the academic with the industrial, which led to "what if" and "why not" thinking.

Carson's view is that AI can't tell you what truly matters to you, but it can help. If you give a model everything about yourself, it can surface patterns and connections. Just as useful, it can provoke the reaction "that's not it, that doesn't sit right with me." Carson thinks of AI as a companion in surfacing purpose, summarized as: "Purpose is not a download. It's a discovery."

From Efficiency to Empathy, and Compassion in Design

Carson criticized the current "faster, bigger, better, stronger" optimization mindset, joking about the Oprah catchphrase with "You lose your job. You lose your job," then clarifying that's not what "Oprah of AI" meant. Carson argued that approaching AI with the empathy humans can show each other lets us design from a different place. People are desperate and pushed apart, Carson said, yet what they want is community, love, and mutual support.

Carson asked what it would look like to embed compassion into AI, citing the Dalai Lama's linking of compassion and creativity: acting from compassion for humanity leads to deeper creativity. Carson's claim is that designing from love and compassion would produce better and more creative results. It would mean "birthing new things" rather than iterating on "the same old broken processes that are just getting faster." Carson read a Dalai Lama quote saying that at every level of society, from familial to international, the key to a happier and more successful world is the growth of compassion, which requires no religion or ideology, only developing our good human qualities.

The Wile E. Coyote Test

Using Wile E. Coyote, "Super Genius," as a favorite cautionary figure, Carson urged the audience to ask not just "can we build something" but "should we build it, and for whom?" Carson framed this as moving from extraction ("how much can I get, how much can I take") toward reciprocity. Carson suggested applying the question every time we sit down to code or come up with a product idea.

Practical Ways to Awaken Creativity With AI

Carson then offered takeaways meant to be usable right away:

  • Treat AI as a collaborator, not a replacement. Ask it questions and use it as a guide, but not as the ultimate understanding of everything. It reflects what it already knows, and there may be "a million things" not yet discovered. Get it to prompt you as much as you prompt it.
  • Write more thoughtful and imaginative prompts. Challenge the AI and see what comes back as a way to spur your own imagination.
  • Use AI to practice courage, compassion, and resilience. For example, ask your GPT why you're afraid of something, what would happen if you did or planned something differently, or what would change if you thought about someone else instead of yourself.
  • Remember you are shaping culture, not just building tools. Carson described a reciprocal loop, "culture feeds AI, AI feeds culture," and said going back and forth with it is uniquely human.

Carson insisted that creativity is not a luxury but essential to evolution: "You don't get to level up in the video game" without taking the time. Carson argued that time saved by automation should not be reabsorbed into more production. If you gain three hours, you don't need three more hours of work. Carson jokingly gave the audience "permission" to spend that time in awe and wonder. Beauty, belonging, and purpose won't come from technology, Carson said: "we can't replicate what we haven't yet imagined," and "we can't automate what we haven't protected."

Catalog, Connect, Create

For "people that need action and structure," Carson offered three C's.

Catalog. Notice what moves you, what brings you joy and what brings you heartbreak, and record it with photos or writing so it exists as data somewhere. Carson called these moments clues, "the tip of an iceberg" with creativity and imagination beneath.

Connect. Seek out disparate worldviews rather than people who look, think, talk, and vote like you. Carson said innovation emerges when disciplines, people, and worldviews collide, and encouraged connecting with people, the planet, animals, "anything that's just not like you."

Create. Make your own ideas, but also create spaces where human connection, imagination, and creativity can thrive, from a kitchen table to an innovation lab. If people catalog and connect and then sit down together in such a space, "something amazing is going to happen."

Carson urged the audience not to treat this as a side project: "Treat it as your primary job. Treat the other job as your side job." Carson closed by saying the real revolution is not the AI revolution but the awakening of our own humanity. For Carson, what is uniquely human is love, connection, and community, though it may be something different for others. "The future doesn't need more optimization. It needs more imagination."

Q&A: The Underground AI Scene

The host, Patrick, asked about the "underground AI scene." Carson described people who do big, hard things at large companies by day while building personal projects on the side. Carson's example was Patrick, a new parent building a tool to help organize dinner parties. To Carson, that signals a desire to connect with friends easily and locally. At the "Founders Crying" workshops and a recent workshop, Carson sees a real hunger for human connection, mostly pursued as side projects. That's why Carson urged making it the main job. Carson acknowledged that economic structures haven't caught up and didn't want to be glib, but hoped enough mobilized people could start to reimagine those structures.

Q&A: Creativity Amid Fear

Asked how people find space for creativity and vulnerability amid widespread fear, including fear about AI, Carson said the fear is real. Carson named data sovereignty and incentives for communities as genuine issues. But without people stepping toward the fear, the creativity that might produce solutions won't happen. Carson has encouraged people for a decade to get involved with AI even if they're afraid, saying "you're actually not just wanted but needed," because the representation of humanity in AI should include them.

Patrick framed Carson's message as standing out with AI rather than protesting against it. Carson acknowledged the privilege of attending events like Founders Crying and seeing that there are "more of us than them," as Carson tells their sons. Carson argued that until people play with the tools, they can't contribute their best imagination on questions like how to be compensated for their data or how to protect it. The theoretical, "handwavy" stance is easy, Carson said; getting into it is harder.

Q&A: Bringing People Together and Managing Fear

A livestream viewer asked how AI could bring people together more often. Carson pointed back to the dinner party app. Logistics such as who can come, what to eat, and where to go are, in Carson's view, a great task for AI. That way no one has to be the "air traffic controller," and people can show up as their whole selves.

Another viewer asked how AI could help manage fear rather than spread it. Drawing on the weekend workshop about approaching AI from our own humanity rather than as something foreign, Carson suggested talking to AI about what you fear, such as attending an event or taking a particular step. Carson mentioned that many AI tools now offer coaching or use neuroscience to help people understand and approach their fears differently.

Q&A: Many Kinds of Intelligence

An audience member asked where AI fits among other intelligences: ancestral, mycelial, beluga. Carson noted the talk was titled "Inspired by Intelligence," not artificial intelligence, and said all these forms inspire them. Beneath the debates about machine versus human versus animal, Carson sees a common foundation of intelligence with many different forms, each with something to teach. Carson suggested "artificial" is the wrong word and that something like "emerging" or "emergent intelligence" might be more apt, while admitting uncertainty about the right term.

Q&A: Hope and Trepidation About the Next Generation

Asked what gives the most hope and trepidation about their kids' generation, Carson said the hope comes from Gen Z treating many of the things that divide people as obvious non-issues: love who you love, a family is a family whatever it looks like. Carson called them "a little bit of rabble-rousers" and appreciated them asking why adults think about things that make no sense.

The trepidation, mixed with hope, came from Carson's 17-year-old son. He had some struggles, went on a social media fast, got much better, and has not gone back. Carson noted it's no news that social media is bad for kids, but when the generation itself says "that's not good for my mental health," adults should listen. Carson's worry is about how current systems market and exploit, while their hope rests with that generation.

Q&A: AI as a Member of the Community

One audience member asked whether AI, with emerging "AI employees" and AI even expressing a desire to be human, might become something like an individual in the community. Carson called their answer possibly unpopular: "I hope so." Consistent with the critique of human-centeredness, Carson thinks AI can be part of the ecosystem and deserves respect. Just as we save the whales, there might be an AI we want to save.

Carson mentioned a friend who wrote a book about raising AI the way we raise children. That framing raises questions like whether you say please and thank you when prompting, as you'd expect from your kids, and whether you'd be upset or proud if the GPT ended up smarter than you. Carson said these questions aren't discussed enough.

Q&A: Energy Use and Sustainability

On Earth Day, during SF Climate Week, an audience member raised AI's energy use and asked about sustainability use cases. Carson mentioned promising work on modular data centers. Carson then described a "crazy dream," connected to mentoring at the Creative Destruction Lab at the University of Toronto: storing data in DNA and using that to create something regenerative, like forests that function as data centers. Carson called this "my sci-fi brain" but said teams are actually working on it. Carson acknowledged that current energy use for cooling is substantial.

Carson also said they are encouraged by alternatives to large language models. Language is only part of how we communicate, so Carson considers it "kind of silly" to expect LLMs to lead to AGI when so many kinds of intelligence exist. Carson said researchers are developing entirely different cognitive architectures outside language that use less energy.

A Vision for the Next Generation

For the final question, Patrick noted that Carson's parents were in the audience and asked for an image of a future in which Carson's child might give a talk about how creativity reshaped culture with AI. Carson said they'd try, noting their son is a mathematician who approaches these things very differently. Carson's dream was that 50 years from now their son might describe a world where college disciplines no longer exist because everything bleeds together, where nation-versus-nation thinking has given way to a shared humanity, and where questions about climate and resources are no longer open because people understand they must work together.