Share
The Foresight Institute Podcast
Tom Burns, Cornell University | At the Interface of AI Safety and Neuroscience
Season 1
•
Speaker
Tom Burns graduated with First Class Honours in his Bachelor of Science from Monash University in 2013, exploring the mathematical features of human perception of non-linguistic sounds. Shifting to philosophy, he completed a Master of Bioethics in 2014, analyzing the ethics of euthanasia legislation in Australia, followed by a World Health Organization Bioethics Fellowship in 2015, contributing to the Ebola epidemic response. In 2023, as a Fall Semester Postdoc at Brown University's ICERM, he contributed to the 'Math + Neuroscience' program. Recently affiliated with Timaeus, an AI safety organization, Tom is continuing his research at Cornell University's new SciAI Center from March 2024.
Session Summary
Neuroscience is a burgeoning field with many opportunities for novel research directions. Due to experimental and physical limitations, however, theoretical progress relies on imperfect and incomplete information about the system. Artificial neural networks, for which perfect and complete information is possible, therefore offer those trained in the neurosciences an opportunity to study intelligence to a level of granularity which is beyond comparison to biological systems, while still relevant to them. Additionally, applying neuroscience methods, concepts, and theory to AI systems offers a relatively under-explored avenue to make headwind in the daunting challenges posed by AI safety — both for present-day risks, such as enshrining biases and spreading misinformation, and for future risks, including on existential scales.
In this talk, Tom presents two emerging examples of interactions between neuroscience and AI safety. In the direction of ideas from neuroscience being useful for AI safety, he demonstrates how associative memory has become a tool for interpretability of Transformer-based models. In the opposite direction, he discusses how statistical learning theory and the developmental interpretability research program have applicability in understanding neuroscience phenomena, such as perceptual invariance and representational drift.
Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcasts
Existential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.
Hosted by Allison Duettmann and Beatrice Erkers
Follow Us: Twitter | Facebook | LinkedIn | Existential Hope Instagram
Explore every word spoken on this podcast through Fathom.fm.
More episodes
View all episodes
Sam Jardine | The Dawn of Astropolitics?
53:48||Season 1Samuel Jardine is a Geopolitical Risk Consultant and Historian specializing in space, polar regions, and seabed security, utilizing Applied History and OSINT. He has lectured for institutions like RUSI and the Royal Navy, with publications by Routledge. Currently, he leads research at London Politica, advises Luminint, and contributes to the Lunar Policy Platform.Main PointsContext and an overview of AstropoliticsSpace law and governance: geopolitical issues, a Multipolar world, and competitionThe effects of the decoupling of US and ChinaCompeting Space Blocks: The Artemis Accords vs. ILRSChallenges and Opportunities in Space CooperationAbout Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Anna Chekovisch | Bitcoin as a Path to Freedom
11:17||Season 1Anna Chekhovich is the financial director of Alexei Navalny’s Anti-Corruption Foundation (FBK) from Russia. Targeted by Putin’s regime, the foundation has gradually lost access to financial institutions. FBK has been using Bitcoin since 2015 to help overcome financial repression. At that time the Russian government began blocking the bank accounts of various foundations, even those very loosely connected to the FBK. Navalny and his family have also had their personal accounts frozen as did many people who worked on the FBK team. Bitcoin has given them a financial tool away from the reach of Putin’s regime.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Eric Drexler | Advanced Nanotechnology
13:53||Season 1Eric Drexler is a visionary scientist and engineer thought of as one of the “Founding fathers of nanotechnology”, the science of engineering on a molecular level. He is most known for being the driving force behind the concept of molecular nanotechnology (MNT) and its potential benefits for humans. His 1981 paper in the Proceedings of the National Academy of Sciences established fundamental principles of molecular design, protein engineering, and productive nanosystems. Drexler’s research in this field has been the basis for numerous journal articles and for books including Engines of Creation: The Coming Era of Nanotechnology, 1986, which is written for a general audience, and Nanosystems: Molecular Machinery, Manufacturing, and Computation. This talk discusses the potential of advanced nanotechnology's potential, focusing on:• Atomic-level manipulation for diverse applications• AI's role in accelerating molecular engineering• Environmental and space exploration implicationsAbout Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the technical programs alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.
31. Existential Hope Podcast: Dr Ariel Zeleznikow-Johnston | The Future Loves You
53:29||Season 2, Ep. 31SpeakerDr Ariel Zeleznikow-Johnston is a neuroscientist at Monash University, Australia, where he investigates methods for characterising the nature of conscious experiences. In 2019, he obtained his PhD from The University of Melbourne, where he researched how genetic and environmental factors affect cognition. His research interests range from the decline, preservation and rescue of cognitive function at different stages of the lifespan, through to comparing different people’s conscious experience of colour.Session SummaryIn this edition of the Hope Drop, we dive into a thought-provoking conversation with Dr. Ariel Zeleznikow-Johnston, neuroscientist and author of The Future Loves You: How and Why We Should Abolish Death. Ariel explores the science and philosophy of brain preservation, questioning long-held beliefs about life, death, and personal identity. We explore how neuroscience might redefine what it means to truly live—and challenge assumptions around mortality.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm.Molly MacKinlay | New Decentralized Mechanisms for Funding Public Goods
14:19||Season 1Molly Mackinlay has extensive work experience in various roles at different companies. She is currently the Head of Engineering, Product, & Research Development at Protocol Labs, where they lead teams working on the IPFS Project. Prior to this, Molly worked at Google where they held multiple roles including Google Search PM II, Google Forms PM, Google Classroom PM, and Associate Product Manager for Chrome Native Client. Before joining Google, she obtained their Bachelor's degree in Computer Science with a concentration in Human Computer Interaction from Stanford University. Key HighlightsExplores decentralized mechanisms for funding public goodsPresents three web3 experiments: Quadratic Funding, DAO treasuries, and Retroactive Public Goods RewardsIntroduces Open Impact Foundation as a legal structure for public goods fundingAbout Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Anders Sandberg | Whole Brain Emulation Ethics
12:07||Season 1Anders Sandberg's research centres on estimating the capabilities and underlying science of future technologies, methods of reasoning about long-term futures, existential and global catastrophic risk, the search for extraterrestrial intelligence (SETI), as well as societal and ethical issues surrounding human enhancement.Topics of particular interest include management of systemic risk, reasoning under uncertainty, enhancement of cognition, neuroethics and public policy. He has worked on this within the EU project ENHANCE, where he was also responsible for public outreach and online presence, and the ERC UnPredict project.Besides scientific publications in neuroscience, ethics and future studies he has also participated in the public debate about human enhancement, existential risk and SETI internationally.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Barbara Diehl | Innovation and Funding Mechanisms at SPRIND
14:06|Barbara Diehl is a proven expert in entrepreneurship, innovation and education and has been facilitating partnerships with science and business at SPRIND since 2020. Prior to joining SPRIND, she had a successful career in the UK and Ireland for 10 years at the Oxford University Entrepreneurship Centre and the Innovation Academy at University College Dublin. In Oxford, she led early-stage investment programs and an executive education program for fast-growing small businesses (Goldman Sachs 10,000 Small Businesses growth program). Key highlights:The work of SPRIND: an initiative by the German government to develop breakthrough innovations, priority areas being circular biome manufacturing, antivirals, long-duration energy storage, and tissue engineering. Plans to improve data availability and advocate for policy changes within universities. The importance of mutual discovery between the US and European innovation ecosystems. The need for flexible and agile funding mechanisms and people funding rather than project funding.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.
30. Existential Hope Podcast: Eli Dourado, Abundance Institute | Accelerating Progress
53:37||Season 2, Ep. 30Eli Dourado is the Chief Economist at the Abundance Institute. He is a former Senior Research Fellow at the Mercatus Center at George Mason University and he has studied and written about a wide range of technology policy issues, including Internet governance, intellectual property, cybersecurity, and cryptocurrency.Session SummaryThis episode covers topics including Dourado’s efforts to accelerate economic growth in the U.S., his views on policy reforms in key sectors such as health, housing, energy, and transportation, and the challenges of regulatory complacency. We also explore the potential of new technologies such as AI and biotechnology. Dourado shares his vision of a future with scalable healthcare solutions, more efficient housing, rapid deployment of energy technologies, and advancements in transportation like supersonic flights and electric vehicles. The conversation concludes on the importance of broad literacy and continuous writing in supporting progress.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm.Gustavs Zilgavis | The Path to Mars Governance
09:27|Gustavs Zilgalvis is a technology and security policy fellow within RAND's Global and Emerging Risks Division, a Ford Dorsey Master's in International Policy candidate at Stanford's Freeman Spogli Institute for International Studies, and a founding Director at the Center for Space Governance. At RAND, he is specializing in the geopolitical and economic implications of the development of artificial intelligence. Previously, Zilgalvis has written about the interface of space and artificial intelligence in Frontiers of Space Technology, held a Summer Research Fellowship on artificial intelligence at Oxford's Future of Humanity Institute, and his research in computational high-energy physics has appeared in SciPost Physics and SciPost Physics Core. Zilgalvis holds a Bachelor of Science with First-Class Honors in Theoretical Physics from University College London, and graduated first in his class from the European School Brussels II.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.