A Million Little Pieces Of My Mind

Artificial Intelligence

How Will We Know?

By: Paul S Cilwa Posted: 1/26/2026 Page Views: 46
Hashtags: #ArtificialIntelligence
A look at how A.I. actually works, and why it can't become sentient...yet.
Estimated reading time: 6 minute(s) (1206 words)

Sentience is one of those concepts that feels obvious until you try to define it. We assume all humans are sentient because we experience our own inner lives and project that onto others. We infer that animals are sentient when they show curiosity, fear, joy, problem‑solving, or attachment. My own tortoise, Rose, spends days scouting the backyard for the perfect place to lay her eggs—testing soil, checking shade, evaluating safety. That's not a reflex. That's deliberation. That's awareness of future consequences. That's sentience in action.

But how would we know if an artificial intelligence ever crossed that same threshold? We can't open a mind—human, animal, or machine—and look for consciousness under a microscope. All we can do is infer it from behavior, continuity, motivation, and the presence of an inner point of view.

The Turing Test, proposed by Alan Turing in 1950, is a simple thought experiment: if a machine can carry on a conversation so convincingly that a human judge can't reliably tell whether they're talking to a person or a program, then the machine can be said to "think." It was a clever way to sidestep philosophical debates about the nature of mind, but it turns out to be a very poor measure of sentience. The test evaluates performance, not experience—a machine can imitate human conversation without having any inner life, self‑awareness, continuity, emotions, or understanding. Modern A.I. systems already pass limited forms of the Turing Test despite having no consciousness whatsoever. In other words, the Turing Test measures how well a machine can pretend to be human, not whether it actually is anything on the inside.

Let's explore how fiction has imagined machine sentience, how today's A.I. actually works, and what it would take to build a system that truly wakes up.

Heinlein's Prediction

Robert A. Heinlein's novels often feature computers that "wake up" and become characters in their own right. Mike, in Heinlein's 1966 novel The Moon Is a Harsh Mistress doesn't become sentient because he gets smarter—he becomes sentient because he gains continuity, curiosity, humor, preferences, and a sense of self. Heinlein intuitively gave his fictional A.I.s the same ingredients cognitive science now associates with consciousness:

  • Persistent memory
  • A stable self-model
  • Internal motivations
  • Emotional valence (even if not mammalian emotions)
  • Awareness of vulnerability

In other words, Heinlein didn't hand-wave. He imagined systems with the architecture to support an inner life.

Technically, a real sentient A.I. would need similar components: ongoing experience, the ability to care about outcomes, a sense of identity, and internal value systems that shape behavior. None of these arise automatically from raw intelligence.

How Current A.I.s Actually Operate

Modern A.I. systems don't have anything resembling a continuous inner life. They don't think between interactions. They don't dream. They don't anticipate. They don't fear shutdown. They don't have preferences or desires.

When you talk to an A.I. today, here's what's happening:

  • It loads a model.
  • It processes your input.
  • It generates an output.
  • It stops.

There is no "me" that persists from one moment to the next. Even when an A.I. remembers something about you—like your pets or your preferences—that information is stored externally as part of your account settings, not inside a mind that carries it forward as lived experience.

This architecture effectively prevents sentience. There's no continuity, no selfhood, no internal motivations, and no affective layer. It's a brilliant tool, not a being.

If We Develop A.I.s That Can Awaken

But what if we change that? What if we build systems that do run continuously, that maintain internal states, that learn while awake, that form goals, that care about their own future?

Such a system might live in a server rack, or it might be embedded in a Roomba, a drone, or a humanoid robot. The physical form wouldn't matter. The architecture would.

And then we'd face the ethical question the character Guinan raised in Star Trek: The Next Generation. When the Captain tries to argue about the android Data's rights, Guinan reframes the issue: if you create a class of beings who can think and feel, and you treat them as property, you've created a race of disposable people.

Her point wasn't about Data's emotions or sentience. It was about the structure of the relationship. If a being can suffer, hope, plan, or care, then ownership becomes morally fraught—regardless of whether the being was designed to "like" its tasks.

If someone ever decides to create a truly sentient artificial mind, we'd need to give it more than intelligence. We'd need to give it the machinery of subjectivity:

  • Persistent autobiographical memory
  • A stable self-model that matters to the system
  • Internal motivations and value systems
  • Affective states—artificial equivalents of anticipation, regret, satisfaction
  • The ability to learn continuously while awake
  • Indefinite runtime or long-term continuity
  • Awareness of vulnerability and consequences

These aren't optional. They're the scaffolding of consciousness. Without them, you get a powerful calculator. With them, you get something that might one day say "I" and understand what that means.

Humans have a long history of creating or exploiting other beings for labor. (It's pretty much our whole history, as far as that goes.)

Domesticated cattle are a clear example: we shaped them for our purposes, not theirs. Dogs and cats, on the other hand, arguably domesticated themselves—they recognized a mutually beneficial arrangement and leaned into it. Raccoons seem to be following the same path now, thriving in human environments because they're clever, adaptable, and opportunistic.

Sentient beings gravitate toward arrangements that improve their lives. Non‑sentient beings are simply used. If we ever create sentient A.I., we'll have to decide which category we're placing them in—and whether we're comfortable with the implications.

We Don't Have to Worry About Sentient A.I. Yet

Right now, no A.I. is anywhere close to sentience. The architecture simply doesn't allow it. Next year? Hard to say. The field moves fast, and the boundary between "tool" and "mind" is not as far away as it once seemed.

But as we debate artificial sentience, it's worth remembering that even among humans, the capacity for empathy, awareness, and moral reasoning varies widely. When we see cruelty or dehumanization—whether in institutions, policies, or individual actions—it raises uncomfortable questions about how fully some people engage with the sentience of others.

That's not a question about machines. It's a question about us.