AI Library
Books for Reading AI
Choose a book, then read it in order from the table of contents.
[AI Library] Chapter 17. Asking Again What Makes Us Human
Brain Readers: Neuralink and the Final Human Revolution
Chapter 17. Asking Again What Makes Us Human
Kim Kyung-jin
A. "Am I My Brain, or Am I the Technological Extension of It?"
In 1998, philosophers Andy Clark and David Chalmers published a paper titled "The Extended Mind." They posed a simple question: "Where does the mind stop and the rest of the world begin?"
Clark and Chalmers introduced a fictional character named Otto. Otto had Alzheimer's disease. He wrote down every important piece of information in a notebook and carried it everywhere. When he wanted to visit a museum, he opened his notebook and checked the address. A woman named Inga, by contrast, had a healthy memory. She recalled the museum's address from inside her head.
What was the difference between these two people.
Clark and Chalmers gave a provocative answer.
There was no difference. Otto's notebook performs the same function as Inga's hippocampus. It stores information and retrieves it when needed. The notebook is not a tool sitting outside Otto's mind. It is part of Otto's mind itself.
Twenty-six years have passed since that paper was published. In January 2024, a Neuralink chip was implanted in Noland Arbaugh's skull. By mid-2025, seven quadriplegic patients had undergone the same surgery. They move computer cursors, operate smartphones, and play video games using thought alone. A patient named Alex created 3D designs with CAD software. Brad played Mario Kart with his children. The extended mind that Clark and Chalmers imagined had become literal reality.
But the experience of Neuralink patients differs in kind from Otto's notebook. A notebook must be opened by hand. It must be read with the eyes. The body stands between thought and action as a mediator. Neuralink skips that mediator. When the motor cortex fires, the signal becomes a digital command directly. The gap between thought and action disappears. Noland Arbaugh said in an interview: "I don't 'consciously' think about moving the cursor. It just moves. Like moving a finger."
Here the philosophical question deepens. Where does Noland Arbaugh end? Is his biological brain "him"? Or is the entire system, brain plus chip plus computer, "him"? Clark wrote in his 2003 book Natural-Born Cyborgs: "What makes humans different from other species is the ability to fully integrate tools and cultural practices into our very being." If you follow his logic,
a person who receives a BCI implant is not simply using a tool. That person has become a new form of human.
In May 2025, a paper published in Nature Communications pushed this discussion one step further. The authors argued that collaboration with generative AI represents a new case of the extended mind. When humans and AI solve problems together, cognition does not reside in either one. The interaction itself is cognition. The authors concluded: "Building hybrid thinking systems is part of human nature."
Not every scholar agrees. Critics point to the "causal-constitution fallacy." A calculator helps you solve a math problem, but that doesn't make the calculator part of your mind. There is also the problem of "cognitive bloat." If you push the extended mind theory to its conclusion, all the information on the internet becomes part of an individual's cognitive system. This defies intuition.
This debate is not a purely academic matter. It carries legal and social implications. If a BCI is part of my mind, then hacking it is not a simple property crime. It is an intrusion into the psyche. If an idea produced through collaboration with AI is a product of the extended mind, who holds the copyright?
How does Noland Arbaugh think about his own identity? Does he feel that Neuralink is part of himself, or does he still perceive it as an external tool? The answer will probably change over time. Just as we became unable to live without smartphones, BCI users will gradually come to experience the device as an extension of themselves. And at that moment, the meaning of the question "Who am I?" will itself be transformed.
B. Storing and Downloading Memory: Is Immortality Possible?
Humanity has long tried to conquer death. We built pyramids. We searched for elixirs of life. We entrusted our bodies to cryonic preservation. In the twenty-first century, a new method was proposed: uploading the mind to a computer.
The idea is straightforward. The human brain consists of 86 billion neurons. Each neuron connects to other neurons through thousands of synapses. This pattern of connections is memory, personality, and consciousness. If we could scan this pattern perfectly and replicate it in a computer, a person's mind could exist in digital form forever.
As of 2025, this idea remains in the realm of science fiction. A neuroscientist at Georgia Tech explains: "We have not yet replaced a single real neuron with an artificial one. I'm not talking about 86 billion. Not even one." The technology to scan a brain is also lacking. We do not even know what level of detail is required for consciousness to function. Is the synaptic connection pattern enough, or must we replicate the molecular state inside each individual neuron? Nobody knows.
Technical barriers are not the only problem. There is a philosophical puzzle. In 1775, the Scottish philosopher Thomas Reid asked: "If my brain loses its original structure, and hundreds of years later the same matter is used to create an intelligent being again, is that being me? If two or three beings are made from my brain, are they all me?" Two hundred and fifty years have passed, and there is still no consensus on the answer.
The modern debate revolves around the Hard Problem of Consciousness. If we cannot explain how physical processes produce subjective experience, we cannot know whether an uploaded mind truly "feels." It might be a conscious being, or it might be a "philosophical zombie" that mimics behavior without any inner experience.
Russian futurist Alexei Turchin proposes a method of gradual replacement: swapping out the brain's neurons one at a time for artificial ones. If continuity of consciousness is maintained at each step, the end result, a fully artificial brain, would still be "me." But this method has problems of its own. A quantum-temporal model of consciousness published in 2025 argues that consciousness cannot be copied or transferred; only a new entity can be created.
There is another concern: sensory deprivation. A digital consciousness has no body. No sight, hearing, touch, taste, or smell. No interaction with the environment. Neuroscientists warn: "Sensory deprivation is recognized as a form of torture. Without contact with an environment, a digital consciousness could experience
hallucinations, mental disorders, and even dissolution of identity." The Netflix series Black Mirror portrayed this scenario in its chilling episode "White Christmas," in which a digital copy is trapped in isolation for what feels like an infinite stretch of time.
So is mind uploading the promise of eternal life, or a new kind of hell? James Hughes, a Buddhist transhumanist, offers a different perspective. If the self is inherently an illusion, then worrying about uploading is pointless. According to the Buddhist concept of anatta (non-self), the "me" of this moment is not identical to the "me" of one second ago. Consciousness is not a continuous stream; it arises fresh in each moment.
The most realistic approach right now is partial preservation: storing fragments of memory, simulating personality patterns with AI, or creating digital avatars based on social media records. Martine Rothblatt calls these "mindfiles" and "mindclones." Several startups already offer chatbots trained on a deceased person's voice and text data. Bereaved families can "talk" to their dead relatives.
Is this true immortality? Probably not. But it is clearly changing the meaning of death. And as technology advances, the very definition of "immortality" may shift. Even if a complete upload of consciousness proves impossible, if some portion of our memories and personality survives in digital form, isn't that, in some sense, life after death? The answer depends not on technology, but on how we choose to define "life" and "death."
C. The End of Language: How Conceptual Telepathy Could Reshape Civilization
Language is the foundation of human civilization. We transmit thoughts through sounds and symbols. But language has a fundamental limitation. When a thought in your head is converted into words, those words into sounds or letters, and the other person interprets them back again, meaning is lost along the way. Poets spend their lives fighting this limitation. There are emotions and experiences that are, as they say, "beyond words."
BCI technology has opened the possibility of bypassing this limitation. One of Neuralink's visions is "conceptual telepathy." Elon Musk explained it this way: "Language is a very slow interface. We can transmit about 40 bits of information per minute. If we could share thoughts directly through BCI, bandwidth would increase by a factor of thousands."
As of 2025, Neuralink patients have achieved typing speeds of about 40 words per minute. That is roughly comparable to how fast an average person types on an on-screen keyboard. Voice restoration technology has also received FDA Breakthrough Device designation. Patients who lost their ability to speak due to ALS will be able to hold conversations through synthetic speech generated by thought alone. But this is still communication mediated by language. It isn't the transmission of thought itself.
What would happen if true conceptual telepathy became possible? Imagine this. You could convey the exact emotion you feel while watching a sunset to another person, without a single word. You could instantly share a complex mathematical intuition. Misunderstandings would vanish. Translation would become unnecessary. Humanity could be connected not through a single language but through a single mind.
But utopian visions carry dystopian shadows. The first is the end of privacy. If thoughts can be shared, unwanted thoughts can also be exposed. We all carry unspoken thoughts in our heads. Prejudice, desire, anxiety, anger. If these became transparent to others, what would happen to social relationships? Is a world where honesty is forced really a better world?
The second is the asymmetry of power. Not everyone would gain telepathic ability at the same time. In the early stages, the wealthy and the powerful would gain access first. They could read other people's thoughts while concealing their own. This would create the most extreme information asymmetry in history.
The third is the dissolution of individuality. Language is not just a communication tool. It shapes the very way we think. A person who thinks in Korean and a person who thinks in English experience the world differently. Language is a core element that constitutes personal identity. In a world where thoughts are shared without language, how would individual uniqueness be preserved? Could collective consciousness replace individual consciousness?
Looking back through history, new communication technologies have always transformed civilization at its foundations. The invention of writing made it possible to externalize memory. The printing press led to the democratization of knowledge. The internet made instant global communication possible. Each revolution produced unexpected consequences. The printing press ignited the Reformation. The internet deepened fake news and polarization.
Conceptual telepathy could bring greater change than all previous revolutions combined. That is because it would not be a change in how we communicate, but a change in how we exist as human beings. We need to think in advance about whether we want that change, and under what conditions we would accept it.
Of course, all of this is still speculation. It is not even certain whether conceptual telepathy is technically possible. Because brain activity patterns differ from person to person, it is unclear whether one person's "experience of watching a sunset" could be transmitted identically to another. Perhaps language, despite its imperfections, or precisely because of them, will remain the only viable form of human communication. Yet the history of technology has been a continuous process in which "impossible" becomes "difficult," and "difficult" becomes "routine."
D. Being Human in the Cyborg Era: Philosophical Questions
On August 9, 2023, the Supreme Court of Chile issued a historic ruling.
The plaintiff was former Senator Guido Girardi. The defendant was Emotiv, a company headquartered in San Francisco. Emotiv sold a brainwave-measuring headset called "Insight." Senator Girardi claimed that after using the device, his brain data had not been adequately protected.
The Supreme Court ruled in the plaintiff's favor. The court found that Emotiv's retention of Girardi's brain data for research purposes without specific consent violated his constitutional rights to physical and mental integrity and his right to privacy. The court ordered the company to delete the plaintiff's neural information from its database.
This ruling was possible because Chile became the first country in the world to enshrine "neurorights" in its constitution in 2021. The amended Article 19 stipulates the "protection of brain integrity and mental immunity from neurotechnology." It also granted brain data the same legal status as organs, making it impossible to buy or sell.
The concept of neurorights was first proposed in 2017 by Rafael Yuste, a neuroscientist at Columbia University. Together with his colleagues, he defined five neurorights: the right to mental privacy, the right to personal identity, the right to free will, the right to fair access to mental augmentation, and the right to protection from algorithmic bias. Yuste argues: "We responded too late to social media. We must not repeat the same mistake with neurotechnology."
There are critics as well. Juan Carlos Lara Galvez of Chile's digital rights organization points out: "Some legal scholars are skeptical about whether such constitutional amendments are necessary. They argue that existing personal data protection laws are sufficient." Daniela Salort Mirales, a law professor at the University of Chile, raises a more fundamental objection: "This constitutional provision is based on the colonial assumption that Chile had no legal protections for brain data."
Neurorights advocates, however, present compelling evidence. When the Neurorights Foundation analyzed the terms of service of 30 consumer neurotechnology companies, it found that 29 of them reserved the right to sell users' brain data to third parties. The moment you click "I agree," your brain data is no longer yours.
Chile's precedent is spreading. Brazil and Mexico are reviewing similar constitutional amendments. Uruguay's parliament has discussed neurorights with Chilean legislators. In the United States, Colorado and California have enacted neural data protection laws. The Latin American Parliament (Parlatino) published a model law on neurorights in 2022, providing a framework and foundational concepts for regulating neurotechnology.
Underlying all of these legal efforts is a single philosophical question. What is a human being? When technology can access our brains, read our thoughts, and perhaps alter our minds, where does human dignity reside?
Transhumanists are optimistic. For them, technological augmentation is the next stage of human evolution. We already correct vision with glasses, improve hearing with hearing aids, and restore mobility with artificial joints. BCI is an extension of the same trajectory. Better cognition, deeper connection, longer life. Technology can make us "better humans."
Bioconservatives are worried. They argue that there is something in "being human" that technology cannot replace. Vulnerability, finitude, imperfection. These are, in fact, the core of the human experience. If technology strips away that vulnerability, we may lose something essential.
Perhaps both perspectives are partially right. Technology will change what it means to be human; that much is certain. But the direction of that change is not predetermined. It depends on what values we choose. Chile's neurorights legislation, and the debate for and against it, is part of that process of choosing.
Noland Arbaugh said in an interview after his Neuralink implant: "I'm still me. The chip didn't turn me into a different person. It just let me do the things I always wanted to do again." His words suggest one answer: technology may not strip us of our humanity but restore what was lost. Whether that holds true in every case, though, and where restoration ends and augmentation begins, we are still searching for answers.
Kim Kyung-jin
Attorney · Former Member of the National Assembly · AI Policy Researcher
© 2026 Kim Kyung-jin. All rights reserved.
