Self Modification Mortality Delusion and Intelligent Agents

Mark Ring2

Description

Self-Modification, Mortality, Delusion and Intelligent Agents Mark Ring2 Laurent Orseau1 1AgroParisTech, Paris, France 2IDSIA, Lugano, Switzerland AGI 2011 USISUPSIIDSIA

• agents delusion


• agi's


• ring self-modification


• intro self-modifiable


• intelligent agents

Sujets

• Intelligent agent

Informations

• Publié par: pefav
• Nombre de lectures: 9
• Langue: English
• Poids de l'ouvrage: 1 Mo

Extrait

Self-Modification, Mortality, Delusion and Intelligent Agents

Laurent Orseau 1

Mark Ring 2

1 AgroParisTech, Paris, France

2 IDSIA, Lugano, Switzerland

AGI 2011

I

ntroSelf-Modifiable Agents What if...

What if...

Delusion Box

Conclusion

Bonus

Orseau, Ring

Self-Modification, Mortality, Delusion and Intelligence

2/35

gents

IntroSelf-Modifiable A What if...

Delusion Box

Conclusion

Bonus

What if... 1 AGI can modify its own source code?

Orseau, Ring

Self-Modification, Mortality, Delusion and Intelligence

2/35

I

ntroSelf-Modifiable Agents What if...

Delusion Box

Conclusion

Bonus

What if... 1 AGI can modify its own source code? 2 the world canreadthe AGI’s code?

Orseau, Ring

Self-Modification, Mortality, Delusion and Intelligence

2/35

I

ntroSelf-Modifiable Agents What if...

Delusion Box

Conclusion

Bonus

What if... 1 AGI can modify its own source code? 2 the world canreadthe AGI’s code? 3 the AGI can modify itsobservations?

Orseau, Ring

Self-Modification, Mortality, Delusion and Intelligence

2/35

I

ntroSelf-Modifiable Agents What if...

Delusion Box

Conclusion

Bonus

What if... 1 AGI can modify its own source code? 2 the world canreadthe AGI’s code? 3 the AGI can modify itsobservations? 4 the world can modify the AGI s source code? ’

Orseau, Ring

Self-Modification, Mortality, Delusion and Intelligence

2/35

I

ntroSelf-Modifiable Agents Overview

Delusion Box

Conclusion

Optimal Self- Modifiable Agents

+ World sees Agent’s code

Bonus

Orseau, Ring

Modifiable Observations (Delusion Box)

+ World can change Agent’s code

Self-Modification, Mortality, Delusion and Intelligence

3/35

I

ntroSelf-Modifiable Agents Overview

Delusion Box

Conclusion

Optimal Self- Modifiable Agents

+ World sees Agent’s code

Bonus

Orseau, Ring

Modifiable Observations (Delusion Box)

+ World can change Agent’s code

Self-Modification, Mortality, Delusion and Intelligence

4/35