The OTHER AI Alignment Problem: Mesa-Optimizers and Inner Alignment

This "Alignment" thing turns out to be even harder than we thought. # Links The Paper: https://arxiv.org/pdf/1906.01820.pdf Discord Waiting List Sign-Up: https://forms.gle/YhYgjakwQ1Lzd4tJ8 AI Safety Career Bottlenecks Survey: https://www.guidedtrack.com/programs/n8cydtu/run Mesa-optimizers: https://aisafety.info/questions/8160/ What is deceptive alignment: https://aisafety.info/questions/8EL6/ Inner vs. outer alignment: https://aisafety.info/questions/8428/ Adversarial training: https://aisafety.info/questions/935A/ # Referenced Videos Intelligence and Stupidity - The Orthogonality Thesis: http://youtu.be/hEUO6pjwFOo 9 Examples of Specification Gaming: https://youtu.be/nKJlF-olKmg Why Would AI Want to do Bad Things? Instrumental Convergence: https://youtu.be/ZeecOKBus3Q Hill Climbing Algorithm & Artificial Intelligence - Computerphile: http://youtu.be/oSdPmxRCWws AI Gridworlds - Computerphile: http://youtu.be/eElfR_BnL5k Generative Adversarial Networks (GANs) - Computerphile: http://youtu.be/Sw9r8CL98N0 # Other Media The Simpsons Season 5 Episode 19: "Sweet Seymour Skinner's Baadasssss Song" 1970s Psychology study of imprinting in ducks. Behaviorism: http://youtu.be/2xd7o3z957c With thanks to my excellent Patreon supporters: https://www.patreon.com/robertskmiles - Timothy Lillicrap - Gladamas - James - Scott Worley - Chad Jones - Shevis Johnson - JJ Hepboin - Pedro A Ortega - Said Polat - Chris Canal - Jake Ehrlich - Kellen lask - Francisco Tolmasky - Michael Andregg - David Reid - Peter Rolf - Teague Lasser - Andrew Blackledge - Frank Marsman - Brad Brookshire - Cam MacFarlane - Jason Hise - Phil Moyer - Erik de Bruijn - Alec Johnson - Clemens Arbesser - Ludwig Schubert - Allen Faure - Eric James - Matheson Bayley - Qeith Wreid - jugettje dutchking - Owen Campbell-Moore - Atzin Espino-Murnane - Johnny Vaughan - Jacob Van Buren - Jonatan R - Ingvi Gautsson - Michael Greve - Tom O'Connor - Laura Olds - Jon Halliday - Paul Hobbs - Jeroen De Dauw - Lupuleasa Ion