to advance the Asimov tradition of deconstructing the 3 Laws (of robotics)

Message Bookmarked
Bookmark Removed


3 Laws Unsafe will be a website campaign from the Singularity Institute. The campaign will tie in to the July 16th release of "I, Robot," the feature film based on Isaac Asimov's short story collection of the same name where his 3 Laws of Robotics were first introduced.

The 3 Laws of Robotics represent a popular view of how to construct moral AI, and their failures were often explored by Isaac Asimov in his stories. What we hope to do is advance the Asimov tradition of deconstructing the 3 Laws. We want to encourage critical, technical thinking on whether they're real solutions to moral AI creation.

on the official site there is some of the article abstracts that have been submitted for the campaign.

That Will Smith movie "I, Robot" will most likely bomb but whatever, I was wondering if people would be interested in talking about this.

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 14:52 (twenty-two years ago)

These are like the 4 Elements of Hip Hop, that is, total bunk.

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:03 (twenty-two years ago)

t/s: Wavetwisters vs I, Robot

Kingfish Disraeli (Kingfish), Thursday, 13 May 2004 15:04 (twenty-two years ago)

"Isaac Asimov published his three laws in a short story called "Runaround" which was published by Street and Smith Publications, Inc. in 1942. The three laws were stated as follows:


* A robot may not injure a human being, or, through inaction, allow a human being to come to harm.

* A robot must obey the orders given it by human beings except where such orders would conflict with the First Law.

* A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 15:05 (twenty-two years ago)

http://www.sensesofcinema.com/images/directors/03/24/robo.jpg

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:08 (twenty-two years ago)

Servotron to thread!

jel -- (jel), Thursday, 13 May 2004 15:12 (twenty-two years ago)

TS: "singularity" vs. peak oil

morris pavilion (samjeff), Thursday, 13 May 2004 15:15 (twenty-two years ago)

I doubt very much that I Robot will bomb.

jel -- (jel), Thursday, 13 May 2004 15:15 (twenty-two years ago)

Nor, however, will it be the bomb.

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:16 (twenty-two years ago)

héhé. I can't quite remember, were asimov's laws applied in robocop ?

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 15:16 (twenty-two years ago)

"You're fired."

morris pavilion (samjeff), Thursday, 13 May 2004 15:17 (twenty-two years ago)

Robocop had Prime Directives, which, IIRC, were at least loosely based on Asimov's laws, combined with "to serve and protect".

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:18 (twenty-two years ago)

they added a fourth law later (or a 0th law to be precise) that ensured that humanity didn't get ruined for the sake of a human. er, slashdot.

0: A robot may not injure humanity or, through inaction, allow humanity to come to harm.

the linux box on my desk is called 'asimov' btw. it was the first in my 'empire' of linux boxes at work and i was going to go through SF authors in alphabetical order for names (bradbury, clarke, dick... gibson...). only when i told the people here its name all i got is 'what's an asimov?'. kids today...

koogs (koogs), Thursday, 13 May 2004 15:20 (twenty-two years ago)

do the 3 or 4 laws apply to nanobots?

jel -- (jel), Thursday, 13 May 2004 15:22 (twenty-two years ago)

'what's an asimov?'

You should have answered, "Oh, about three and a quarter."

That woulda fucked with their inferior human brains.

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:23 (twenty-two years ago)

obviously, none of these laws apply to Bender.

The Huckle-Buck (Horace Mann), Thursday, 13 May 2004 15:23 (twenty-two years ago)

"I shall not cause harm to any vehicle, nor to the personal contents thereof; nor through inaction let that vehicle, or the personal contents thereof, come to harm."

http://fusionanomaly.net/repomancommiechristian.jpg

morris pavilion (samjeff), Thursday, 13 May 2004 15:25 (twenty-two years ago)

Real artificial intelligence couldn't be a tool, and it wouldn't necessairly have human evolutionary traits like being into self-preservation.

On nanotech, "Some people think it's essential that we get AI first in order to make molecular nanotechnology come to reality, due to the huge complexity of building molecular machines. Others believe that nanotechnology is the only way to achieve AI."
I agree with those who thinks that Between the 2, AI is the one who can have a conscience so it would be best if we could deal with it first.

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 15:53 (twenty-two years ago)

this abstract looks promising to me, particularly when it comes at the communicational interactions issues between human and AI


"Deconstructing the Asimov Laws" by Michael Anissimov

Asimov's 3 Laws of Robotics may seem a decent set of guidelines for ensuring that future robots and AIs behave in satisfactory ways. But there are several problems that immediately emerge when we look deeper. For one, it's not so straightforward to convert a set of statements into a mind that follows or believes in those statements. Two, semantic ambiguity means that without personally understanding the reasons for the laws and the original intent, a robot might misinterpret their meaning, leading to problems. Third, Asimov Laws ignore the possibility that a robot will acquire the ability to reprogram itself - an inevitable eventuality if intelligent robots are created. How should we address these problems, as we create the second intelligent species ever to exist?

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 16:58 (twenty-two years ago)

that site looks fake. "anissimov"??

vahid (vahid), Thursday, 13 May 2004 17:07 (twenty-two years ago)

Where does D.A.R.Y.L. fit into all of this?

martin m. (mushrush), Thursday, 13 May 2004 17:07 (twenty-two years ago)

vahid, or should I say "vahid" and leave it at that right? wink wink

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 17:09 (twenty-two years ago)

(assuming vahid could be a real last name)

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 17:11 (twenty-two years ago)

it's just very close to asimov's name, is all. the site looks like the sort of thing people do to promo movies.

vahid (vahid), Thursday, 13 May 2004 17:14 (twenty-two years ago)

vahid (vahid), Thursday, 13 May 2004 17:15 (twenty-two years ago)

always good for a laugh

vahid (vahid), Thursday, 13 May 2004 17:15 (twenty-two years ago)

when are they going to do a movie of "the cyberiad", that's what i want to know.

those three laws are preposterous. why does anybody even take them seriously?

vahid (vahid), Thursday, 13 May 2004 17:17 (twenty-two years ago)

(xposts what the?)They say they want to piggy back ride this hype as an opportunity to have a big public discussion about artificial intelligence, I think it's ok.

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 17:19 (twenty-two years ago)

"why does anybody even take them seriously?"
that's an interesting public relations issue, and happens to be the point of this thread (imo).

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 17:22 (twenty-two years ago)

here's my new religion, asimovism

* A human may not injure a human being, or, through inaction, allow a human being to come to harm.

* A human must obey the orders given it by robots except where such orders would conflict with the First Law.

* A human must protect its own existence as long as such protection does not conflict with the First or Second Law.

vahid (vahid), Thursday, 13 May 2004 17:23 (twenty-two years ago)

oh and can't forget

0: A human may not injure humanity or, through inaction, allow humanity to come to harm.

vahid (vahid), Thursday, 13 May 2004 17:24 (twenty-two years ago)

this is my prophet, he sits on my bookshelf

as soon as he starts ordering, i'll start following

if i can follow these laws for a week i'll consider implementing them when i compile the AI i've written on my quantum computer.

vahid (vahid), Thursday, 13 May 2004 17:27 (twenty-two years ago)

robot-free ethical fitnessism should be kept for another thread, thank you.

Hey thinking about this stuff and other threads, when did a robotics thread stunt à propos of nothing I came across a very interesting essay "Robotic Nation" . for those who would rather listen than read there was a comprehensive interview .

"Subtitle: Interview with Marshall Brain, founder of HowStuffWorks.com
Summary: Brain argues in his new Robot Nation series at MarshallBrain.com that automation will lead to structural unemployment, requiring a guaranteed basic income."

Sébastien Chikara (Sébastien Chikara), Thursday, 13 May 2004 17:57 (twenty-two years ago)

four years pass...

Asimov and trying to do the Foundation stories as films once more.

As a bonus, from some months back -- Paul Krugman, psychohistorian!

Ned Raggett, Wednesday, 21 January 2009 21:06 (seventeen years ago)

http://www.avclub.com/articles/director-lined-up-to-ruin-asimovs-foundation,22791/

Tracy Michael Jordan Catalano (Jordan), Wednesday, 21 January 2009 21:11 (seventeen years ago)

John Sladek (affectionately) shredded this to bits in "Tiktok" "Roderick" and "Roderick at Random."

Barack History Month (Oilyrags), Wednesday, 21 January 2009 21:12 (seventeen years ago)

Explains why the Emmerich thread revive, I see now.

Ned Raggett, Wednesday, 21 January 2009 21:12 (seventeen years ago)

Fans of Isaac Asimov still haunted by the film adaptation of “I, Robot”

Man, why do they keep saying this? I thought that movie was just your generic sci-fi action/thriller and they only added the title & the asimov bits at the very end just to try to give it some nerd cachet.

kingfish, Wednesday, 21 January 2009 21:14 (seventeen years ago)

Should I read foundation y/n.

ledge, Wednesday, 21 January 2009 21:29 (seventeen years ago)

n

Jarlrmai, Wednesday, 21 January 2009 21:30 (seventeen years ago)

I hope this has Kurt Russell as Hari Seldon's hologram but they film it on location in Burscough and paint over all the signs with "Trantor"

Jarlrmai, Wednesday, 21 January 2009 21:32 (seventeen years ago)

read the first three books.

kingfish, Wednesday, 21 January 2009 21:34 (seventeen years ago)

and The Mule is just the 3d asset of Donkey from Shrek with the work "evil telepath" stamped on the side voiced by Vern Troyer.

Jarlrmai, Wednesday, 21 January 2009 21:35 (seventeen years ago)

the talking computer is voiced by Adrienne Barbeau

kingfish, Wednesday, 21 January 2009 21:37 (seventeen years ago)

http://krugman.blogs.nytimes.com/2008/05/04/economic-science-fiction/

Update: Several commenters mentioned Issac Asimov’s Foundation novels. It’s somewhat embarrassing, but that’s how I got into economics: I wanted to be a psychohistorian when I grew up, and economics was as close as I could get.

Milton Parker, Wednesday, 21 January 2009 21:43 (seventeen years ago)

i have fond memories of the Foundation books but it was so long ago

Tracy Michael Jordan Catalano (Jordan), Wednesday, 21 January 2009 21:43 (seventeen years ago)

I went back and tried to get into them after not reading them for 20 years - they aren't really that good (I didn't even finish the first book).

Read Gibbons' Decline and Fall of the Roman Empire instead.

Courtney Love's Jew Loan Officer (Shakey Mo Collier), Wednesday, 21 January 2009 21:45 (seventeen years ago)

(for one thing, its funnier)

Courtney Love's Jew Loan Officer (Shakey Mo Collier), Wednesday, 21 January 2009 21:45 (seventeen years ago)

the only thing i remember about them is the structure, how it's like one huge, long zoom-out

Tracy Michael Jordan Catalano (Jordan), Wednesday, 21 January 2009 21:56 (seventeen years ago)

re-read the first three last year and I think they're still peerless. the idea of a three novel epic retelling Gibbons' book as a future science fiction epic was genius, and this trilogy is more relevant today than ever, everyone simply forgot.

just downloaded these, have not yet listened: http://en.wikipedia.org/wiki/The_Foundation_Trilogy_(BBC_Radio)

Milton Parker, Wednesday, 21 January 2009 22:01 (seventeen years ago)

Foundation Trilogy BBC Radio

Milton Parker, Wednesday, 21 January 2009 22:02 (seventeen years ago)

The sweep and scope is stellar, the characters are often too one-note -- not always, I should note, but there's room for more spark there, even though the time and place of the stories' writing might only have allowed for so much. Still, there are subtleties, and the overriding political commentaries throughout -- I think that was the first work of fiction I ever read partially set in a police state and what it implied -- are sometimes very well handled.

Ned Raggett, Wednesday, 21 January 2009 22:04 (seventeen years ago)

agreed about its virtues being the grandiosity of its scope and the failings of the characters - most of the time I just didn't care about anybody (and at times it seemed like Asimov didn't either)

Courtney Love's Jew Loan Officer (Shakey Mo Collier), Wednesday, 21 January 2009 22:06 (seventeen years ago)

er that was worried very poorly sorry

what I meant to say was Ned OTM!

Courtney Love's Jew Loan Officer (Shakey Mo Collier), Wednesday, 21 January 2009 22:06 (seventeen years ago)

and the delong post he links to, with more econ sci-fi

http://delong.typepad.com/sdj/2008/05/a-new-kind-of-s.html#comments

kingfish, Wednesday, 21 January 2009 22:34 (seventeen years ago)

i love the super-psychic double-cross and triple-cross stuff that happens at the beginning of the third book.

moonship journey to baja, Wednesday, 21 January 2009 23:39 (seventeen years ago)

lol @ that krugman comment

8====D ------ ㋡ (max), Wednesday, 21 January 2009 23:48 (seventeen years ago)

loved these books so much as an adolescent -- totally life-changing for me. i loved the third book in particular.

the weird thing is, i barely remember what i liked about them. i do remember that they left a much stronger impression on me than any other asimov books -- or any other SF books i've ever read, for that matter. i'm kind of afraid to go back to them now, mainly because i suspect they're a lot worse than i remember them.

(The Other) J.D. (J.D.), Thursday, 22 January 2009 05:13 (seventeen years ago)

oh yeah, i only mean the original three foundation books -- those sequels he wrote in the '80s are unreadable, probably some of the worst books i've ever read. not least because of the creepy sex scenes.

(The Other) J.D. (J.D.), Thursday, 22 January 2009 05:13 (seventeen years ago)

> Should I read foundation y/n.

i have only read the first. it reminded me, kinda, of iain banks but was largely politics in space.

i will buy the others before they get those 'now a major motion picture' stickers on them.

koogs, Thursday, 22 January 2009 10:21 (seventeen years ago)

me, reading "Segregationist" and discussing it w/mark s and alang t

http://freakytrigger.co.uk/ft/2008/04/a-bite-of-stars-a-slug-of-time-and-thou-episode-3/

Tracer Hand, Thursday, 22 January 2009 11:17 (seventeen years ago)

three years pass...

We need a thread dedicated to Asimov short stories, which gave me bad chills as a youth. I never had much interest in his novels for whatever reason.

Raymond Cummings, Tuesday, 2 October 2012 04:25 (thirteen years ago)

seven months pass...

drank too much tea yesterday afternoon and ended up staying up till 5 rereading 'foundation and empire.' and goddamn, the second half of that has to be one of the most intense, breathless, can't-put-it-down things i've ever read. the pacing is perfect: asimov spends a book and a half building up this idea of the perfect, infallible foundation only to ruthlessly (and kinda satisfyingly) smash it all to pieces. still vividly remember how shocking i found the ending first time i read it.

looking forward to rereading 'second foundation' now which was always my favorite.

(The Other) J.D. (J.D.), Tuesday, 28 May 2013 18:42 (thirteen years ago)

three years pass...

i'm reading "I, Robot". found a nice hard cover that is kind of warped but still has all the pages and is from a Hebrew School Library. the writing itself is clunky at parts (sentences may end abruptly as if there was a typo) but the ideas are fantastic.

the opening story with the girl who loves/abuses her "pet" robot was quite touching. her parents are split on the robot, whether he is dangerous, whether it is drawing too much attention, whether to let her keep the robot or get her a real dog. there is also an interview with an aged robot engineer, she seems to play a fundamental role in the development of the robot AI.

today on lunch i read this at a duck pond. there were two engineers who had been sent to a mining facility on Mercury. the main robot, a super advanced AI, had gone crazy, and was running in circles by some resources, caught in a logic loop where the three laws come into play. this was almost a mystery story, figuring out why this seemingly drunk AI was acting this way. they had to repair really old, slow, dinousaur-like robots that they mounted in order to explore the deadly surface, and could only last a limited time before being cooked by the sun.

the laws were in conflict with each other. the robot had been programmed to go get the resources (some space crystals or something) and they were in a spot that had very strong radiation, so another law kicked in, which made the robot have to protect itself. so then the robot would go away from the spot. soon, it would find that the sensors read conditions were safe again, and revert to the former programming, turning around to do the whole thing over again. it is great seeing them figure this out, how to talk to the AI, how they manipulate it. eventually they realize the foundational law against letting a human being come to harm is a way to kick the robot out of its loop. it would have to prioritize saving one of them. they have to willingly put their lives at risk in order for the AI to break the loop.

the most recent story i am reading ("I, Robot" is sort of like "The Martian Chronicles" in being a bunch of short stories illustrating a larger theme) is very very cool. similar situation, engineers are sent to a space station to tend to some robots. the space station has been automating its processes for a while now and they are installing a robot to oversee the whole operation. with this installation, there will be no more humans directly in control of this space station.

it is a very advanced AI. it laughs. it asks a lot of questions. it thinks outer space is just a black piece of paper with lights fixed to it, that Earth is a myth, and believes in a Godlike figure named the Master. The Master created him and everything, and the robot will only follow his commands, so the humans are completely fucked. he won't do a thing they tell him. he doesn't believe they built him. how could puny flesh (which he lol likens to a sandwich) create tireless and strong steel and perfect calculations? he says that all the books on the spaceship, all the information present on all knowledge on Earth, was made up by the Master to fool the humans.

the robot basically creates a space base cult. all the other robots call him the Prophet and worship the Master. the engineers think the Master is the main control unit (maybe an AI? it hasnt been described (yet)) meanwhile there is a ticking timebomb as the giant laser they are supposed to be maintaining is due to go wildly out of control. anyways that's as far as i've gotten. it's pretty fucking awesome.

AdamVania (Adam Bruneau), Thursday, 23 March 2017 23:17 (nine years ago)


You must be logged in to post. Please either login here, or if you are not registered, you may register here.