den: (Default)
den ([personal profile] den) wrote2006-03-16 06:08 pm
Entry tags:

noodeling

I've been wondering how Asimov's Three Laws of Robotics applied to the Bugs, since they're robots, and the more I think about them the more I feel the Laws are in the wrong order.

1. A robot may not harm a human being, or, through inaction, allow a human being to come to harm.

This directive should stand as-is. It's a moral compas we humans live by (or should.) This directive is causing the Bugs the greatest trouble at the moment; the people they were spying have been injured due the the Bug's actions. The robots didn't actually do the harming but they provided the data that resulted in it. This Is Not OK.

Which brings us to the next two laws:
2. A robot must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
3. A robot must protect its own existence, as long as such protection does not conflict with the First or Second Law.

These two I have a problem with. I feel a robot should protect it's own existence first, THEN obey orders.

Directive 2 should read
2. A robot must protect its own existence, as long as such protection does not conflict with the First Directive.

This way a robot can't be ordered to kill itself. It would be a real bugger if I sent my robot out to get milk, and some hoon at the mall told it to tear its head off. The robot would have to either tear its head off and junk itself on the spot, or it would prioritize the orders, return home, hand me my milk then tear its head off in my kitchen, leaving me to think "What the HELL...?"

Then we come to Law 2 (or Directive 3 under the new ordering). I think the robot should recognize 2 classes of humans: Its Owner (or the people it has been assigned too) and Everyone Else.

I say "assigned to" because I think in some cases the robot would come from a robotic labour pool. In Freefall Helix has been assigned to Sam (for Sqid values of Assigned 8) ) ; in 21st Century Fox tunnel borer 007 was assigned to Jack, Archeron was assigned to Joe and Veronica. On space stations it would be silly to bring your own robot when they can be built them on board much cheaper than the cost of freighting one.

So Law 2/ Directive 3 needs to be split into two, like this:

3. A robot must obey the orders given to it by it's human owners, or the humans it has been assigned to, except where such orders would conflict with the Directive One or Directive 2.

4. A robot must obey the orders given to it by humans, except where such orders would conflict with the Directive One or Directive Two or Directive Three.


So, gathered together, these are the Four Directives that give robots their moral compass in the Deniverse inhabited by the Bugs, various AIs (which you haven't met) and other robots:

1. A robot may not harm a human being, or, through inaction, allow a human being to come to harm.

2. A robot must protect its own existence, as long as such protection does not conflict with the First Directive.

3. A robot must obey the orders given to it by it's human owners, or the humans it has been assigned to, except where such orders would conflict with the Directive One or Directive Two.

4. A robot must obey the orders given to it by humans, except where such orders would conflict with the Directive One or Directive Two or Directive Three.

It's easy to WRITE these, but I imagine CODING them for a real robot would be a nightmare.

The only trouble is...

[identity profile] wyrm.livejournal.com 2006-03-17 09:11 pm (UTC)(link)
The swapping of the second and third laws lends itself to all manner of problems. If a robot decided that to protect its existence it had to take over the world, then it would happily do so and there would be mothing anyone could do about it. Sure he'd make certain no human was harmed, but it wouldn't be all that nice for humanity. Which leads me to the problem with the first law, that being the definition of 'harm'. It effectively means that your expensive robot would be helping everyone it met no matter what you had ordered it to do. It could be argued that unless the robot did something about it, all those people consuming large amounts of alcohol and having a jolly good time were actually harming themselves; so the robot just better take care of all that for humanities own good. A sort of Puritanical enforcer. :8)

Re: The only trouble is...

[identity profile] dewhitton.livejournal.com 2006-03-17 10:01 pm (UTC)(link)
There would have to be some sort of Acceptable Risk programming, which would be more complex than the 3 or 4 Laws programming.

I've decided the 4 laws I wrote about should be re-orded to 1-3-2-4