AI Literacy · Stage 6

When a Machine Must Not Decide

A machine can sort, count and suggest — but some choices are too big and too human for any machine. Decisions about a life, about a person's dignity, or about justice always need a responsible person, because a machine has no conscience, no empathy and can never be held accountable. A machine may help, but a person must decide.

✦ AI Literacy📘 Stage 6 · S6⏱ ~10 min🧒 Ages 10–12★ Free to start
I can name when a machine must never decide.
Kavi the owl for AI Literacy
📖

Kavi and the Robot Judge

A shiny new Fairness Robot arrives in Kavi's class, promising to settle every argument. When two friends quarrel, it beeps and instantly announces who is guilty and what their punishment should be. Kavi frowns and tilts her head. "Wait — a machine can count and sort very fast, but it can't feel sorry, it can't truly understand us, and it can never be responsible for what happens to a person." She looks around the room. "Some choices are just too big and too human. A machine may help us — but who is guilty, who is hurt, who matters: a person has to decide those. Never a machine."

🎓

What your child will learn

1A machine vs a personA big choice has to be made, and a machine is offering to make it. Before you let it, ask what each one can really do. Tap each card.
2Who gets to decide?A quick test: is the choice about a life, a person's dignity, or justice? If yes, only a person decides. If it is small, factual and easy to undo, a machine may help. Tap a row to hear it.
3Help, or must a person decide?A machine is ready to help with all of these. For which ones is that fine — and which ones must a person decide? Judge each one and tap a box.
4Should the machine decide this one?In each case a machine wants to make the choice. Decide whether that is fine or whether a person must decide, then check. Tap Next test for more.
🔍

A peek inside

A self-driving ambulance's computer wants to choose, all by itself, which of two badly hurt people to help first. Should a machine make that choice?
This is a decision about a life — maybe two lives. Choosing who to help first needs someone who understands what is at stake, who cares, and who can be held responsible for the choice. A machine has none of that; it only runs its steps. So the computer may help by sharing information quickly — where each person is, how badly hurt — but a responsible person, like a paramedic, must make the actual decision.

Try this at home: Name one kind of decision a machine must never make on its own.

💬

Questions parents ask

+When must a machine never be the one to decide?

Whenever the choice is about a life, a person's dignity, or justice. Who gets medical care, whether someone is a 'good' or 'bad' person, whether a person is guilty, who is rescued first, who belongs — these need conscience, empathy and a responsible person who can be held accountable. A machine has none of those, so it may help and inform, but it must never make the final decision.

+Can a machine help with a serious decision at all?

Yes. A machine may gather and sort information, do the maths, or lay out the facts — that can be very useful. But a responsible person must weigh what is kind, fair and right and make the final call. The rule is: a machine may help, but a person must decide anything about a life, dignity or justice.

+What kinds of decisions ARE safe to leave to a machine?

Small, factual, low-stakes choices that are easy to undo — suggesting a song, finding the fastest route, checking spelling, sorting photos, filtering spam, guessing the weather. No one's life, dignity or justice is at stake, and a person can always override the result.

+Why can't a very advanced machine be trusted to decide these things?

Being fast, confident or clever is not the same as having conscience, empathy or responsibility. A machine only follows the steps and patterns it was given; it cannot truly care, cannot be held accountable, and cannot answer for a choice that harms a person. No amount of cleverness changes that.

+What age is this lesson for?

It is a Stage 6 (Advanced, roughly ages 11–12, secondary-ready) lesson in KAVI Academy's AI-literacy track. It builds on earlier ideas that machines only follow steps and that persons — not systems — hold responsibility, and asks children to reason about the limits of machine decision-making, using a story, sorting, prediction and reasoning games with light reading.

+Is the lesson free?

Yes — this overview and the printable PDF handout are free. The full interactive lesson and the endless practice are part of KAVI Academy.

Ready to play and learn?

Start the free interactive lesson, or print the handout for screen-free play.

Part of AI Literacy · Stage 6 · S6 on KAVI Academy — a secular, whole-child learning platform for ages 5–12.