Chapter 164: Second Monday (9)
"Like Asimov’s three laws?" asked Samantha.
"No, those are fine for fiction, but it’s impossible to define in a logical framework," said Madison.
"Why not a hard-coded value system?" asked Miranda.
"How would that work?" asked Madison.
"Pretty much everything humans do is guided by values. We value breathing over thirst, thirst over hunger, sex over sleep, and our own life over that of a stranger’s life. A mother values the lives of her children over her own, usually. If we give an AGI the right values, then it won’t betray humanity because it cannot betray its own values."
"That’s a good idea, Miranda. I want you and Madison to work together to find experts that can help you with solving the AGI problem. I’ll just templatize them, and you can consult them whenever you need to."
"But I thought you were only going to templatize people if they gave you permission?" asked Madison.
"I changed my mind," he said. "We can keep track of their contributions and find a way to compensate them later, but I think this is important enough that we don’t have the luxury of niceties."
Miranda smile triumphantly.
"Rina, I want you to focus on VR and photonic chip development."
"I have an idea," she said.
"Oh?"