{"version":"1.0","type":"rich","provider_name":"Acast","provider_url":"https://acast.com","height":250,"width":700,"html":"<iframe src=\"https://embed.acast.com/$/6527e4f1d40c9700125f42de/6544a3625a58af00136802f8?\" frameBorder=\"0\" width=\"700\" height=\"250\"></iframe>","title":"Jan Leike | Superintelligent Alignment ","description":"<p><strong>Jan Leike</strong> is a Research Scientist at Google DeepMind and a leading voice in AI Alignment, with affiliations at the Future of Humanity Institute and the Machine Intelligence Research Institute. At OpenAI, he co-leads the Superalignment Team, contributing to AI advancements such as InstructGPT and ChatGPT. Holding a PhD from the Australian National University, Jan's work focuses on ensuring AI Alignment.</p><p><br></p><p><strong>Key Highlights</strong></p><ul><li>The launch of OpenAI's Superalignment team, targeting the alignment of superintelligence in four years.</li><li>The aim to automate of alignment research, currently leveraging 20% of OpenAI's computational power.</li><li>How traditional reinforcement learning from human feedback may fall short in scaling language model alignment.</li><li>Why there is a focus on scalable oversight, generalization, automation interpretability, and adversarial testing to ensure alignment reliability.</li><li>Experimentation with intentionally misaligned models to evaluate alignment strategies.</li></ul><p><br></p><p>Dive deeper into the session: <a href=\"https://foresight.org/summary/jan-leike-super-intelligent-alignment-intelligent-cooperation-workshop/\" rel=\"noopener noreferrer\" target=\"_blank\">Full Summary</a></p><p><br></p><p><strong>About Foresight Institute</strong></p><p><a href=\"https://foresight.org/\" rel=\"noopener noreferrer\" target=\"_blank\">Foresight Institute</a> is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.</p><p><br></p><p><strong>Allison Duettmann</strong></p><p>The President and CEO of Foresight Institute, Allison Duettmann directs the <a href=\"https://foresight.org/intelligent-cooperation/\" rel=\"noopener noreferrer\" target=\"_blank\">Intelligent Cooperation</a>, <a href=\"https://foresight.org/molecular-machines/\" rel=\"noopener noreferrer\" target=\"_blank\">Molecular Machines</a>, <a href=\"https://foresight.org/biotech-health-extension-program/\" rel=\"noopener noreferrer\" target=\"_blank\">Biotech &amp; Health Extension</a>, <a href=\"https://foresight.org/neurotech-improving-cognition-program/\" rel=\"noopener noreferrer\" target=\"_blank\">Neurotech</a>, and <a href=\"https://foresight.org/space-expanding-outward-program/\" rel=\"noopener noreferrer\" target=\"_blank\">Space </a>Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like \"Superintelligence: Coordination &amp; Strategy\" and \"Gaming the Future\".</p><p><br></p><p>Get Involved with Foresight:</p><ul><li>Apply: <a href=\"https://foresight.org/apply/\" rel=\"noopener noreferrer\" target=\"_blank\">Virtual Salons &amp; in-person Workshops</a></li><li>Donate:<a href=\"https://foresight.org/donate/\" rel=\"noopener noreferrer\" target=\"_blank\"> Support Our Work</a> – If you enjoy what we do, please consider this, as we are entirely funded by your donations!</li></ul><p><br></p><p><strong>Follow Us:</strong><a href=\"https://twitter.com/foresightinst\" rel=\"noopener noreferrer\" target=\"_blank\"> Twitter</a> |<a href=\"https://www.facebook.com/ForesightInstitute/\" rel=\"noopener noreferrer\" target=\"_blank\"> Facebook</a> |<a href=\"https://www.linkedin.com/company/foresight-institute/\" rel=\"noopener noreferrer\" target=\"_blank\"> LinkedIn</a></p><p><br></p><p>Note: Explore every word spoken on this podcast through<a href=\"https://fathom.fm/\" rel=\"noopener noreferrer\" target=\"_blank\"> Fathom.fm</a>, an innovative podcast search engine.</p>","author_name":"Foresight Institute"}