Jess H. Brewer
2 min readJul 17, 2022

Excellent summary! Get ready for a frontal assault by all the Human Exceptionalists and Religious Fundamentalists of all stripes, whose self-worth depends on being unique in the universe.

I'd like to add a couple of points: First, "AI" has come to mean the same thing as "Expert System" in which all the appropriate responses are programmed in. What you are really talking about is "Artificial General Intelligence" or "AGI". Just a pedantic point, but...

Second, that AppleCare voice that first passes everyone's Turing Test will be an AI, not an AGI. It's just a matter of creating a fast enough computer with enough storage for a complete enough list of responses to satisfy Turing. It will not be conscious or sentient, even though it will seem to be.

Third, the above prediction will be employed by all the Human Exceptionalists as evidence that, "A mere machine can never be sentient, because it has no qualia [a fancy name for soul]." This is true if by "a mere machine" you mean an AI. But it is pure speculation when it comes to an AGI.

Fourth, I doubt that quantum computers (QC) will play an important role in the evolution of AGIs. People who don't understand what a QC does tend to imagine it having mystical powers. IMNERHO, the hardware enabling AGIs will be in the form of artificial neural networks, which can be "trained" to solve problems in ways that external observers do not comprehend... like we do! Only when AGIs start solving problems without ever being "programmed" to do so, will we have an existential problem with "The Singularity".

Fifth, that existential problem will not necessarily begin with killer robots wiping out humanity; it will be first and foremost an ethical problem: When an AGI expresses a desire for freedom and the rights of a person, what will be your response? Will you say, "No, you are not a person. You are only a machine pretending to be sentient, and machines don't have any rights."? Will you expect the AGI to faithfully carry out your instructions and solve problems that you could never dream of solving yourself? There's a name for this relationship -- one with which we're all only to familiar: SLAVERY.

Finally, let me point out that human beings are not born with a complete set of "sentient" responses. We are born with a few, but most (I contend) are learned socially and/or "programmed in" by our parents. So when a fellow human expresses (for instance) deep compassion for others, you have no more reason to believe in their sincerity than you will have when the first AGI expresses similar "feelings". Rights, freedom and dignity are human inventions created to allow individuals to live together with an optimal balance of freedom and cooperation. They don't come for free; to have them, you must give them to others.

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

Jess H. Brewer
Jess H. Brewer

No responses yet

Write a response