Share
The Foresight Institute Podcast
Matjaz Leonardis | Interpretability and Security of AI Models
Matjaž Leonardis, in collaboration with David Deutsch at the University of Oxford, is advancing the understanding of a theorem by Popper and Miller from 1983, offering new insights into Bayesian updating and its standard interpretations. His research interests span learning and creativity in both humans and machines. Beyond his academic pursuits, Matjaž engages with a wider audience through social media on topics ranging from education to computation.
Key Highlights
- The use of ML models for critical decisions and the inherent risks of undetectable back doors influencing results.
- Matjaz's paper on the practicality of inserting concealed back doors during ML training and their impact on model integrity.
- Challenges to model interpretability and robustness posed by these back doors, alongside their relevance to AI safety.
- The call for deeper research into complex ML model vulnerabilities, integrating cryptography to enhance computational clarity.
Dive deeper into the session: Full Summary
About Foresight Institute
Foresight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.
Allison Duettmann
The President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".
Get Involved with Foresight:
- Apply: Virtual Salons & in-person Workshops
- Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!
Follow Us: Twitter | Facebook | LinkedIn
Note: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.
More episodes
View all episodes
Anna Chekovisch | Bitcoin as a Path to Freedom
11:17||Season 1Anna Chekhovich is the financial director of Alexei Navalny’s Anti-Corruption Foundation (FBK) from Russia. Targeted by Putin’s regime, the foundation has gradually lost access to financial institutions. FBK has been using Bitcoin since 2015 to help overcome financial repression. At that time the Russian government began blocking the bank accounts of various foundations, even those very loosely connected to the FBK. Navalny and his family have also had their personal accounts frozen as did many people who worked on the FBK team. Bitcoin has given them a financial tool away from the reach of Putin’s regime.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Eric Drexler | Advanced Nanotechnology
13:53||Season 1Eric Drexler is a visionary scientist and engineer thought of as one of the “Founding fathers of nanotechnology”, the science of engineering on a molecular level. He is most known for being the driving force behind the concept of molecular nanotechnology (MNT) and its potential benefits for humans. His 1981 paper in the Proceedings of the National Academy of Sciences established fundamental principles of molecular design, protein engineering, and productive nanosystems. Drexler’s research in this field has been the basis for numerous journal articles and for books including Engines of Creation: The Coming Era of Nanotechnology, 1986, which is written for a general audience, and Nanosystems: Molecular Machinery, Manufacturing, and Computation. This talk discusses the potential of advanced nanotechnology's potential, focusing on:• Atomic-level manipulation for diverse applications• AI's role in accelerating molecular engineering• Environmental and space exploration implicationsAbout Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the technical programs alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.31. Existential Hope Podcast: Dr Ariel Zeleznikow-Johnston | The Future Loves You
53:29||Season 2, Ep. 31SpeakerDr Ariel Zeleznikow-Johnston is a neuroscientist at Monash University, Australia, where he investigates methods for characterising the nature of conscious experiences. In 2019, he obtained his PhD from The University of Melbourne, where he researched how genetic and environmental factors affect cognition. His research interests range from the decline, preservation and rescue of cognitive function at different stages of the lifespan, through to comparing different people’s conscious experience of colour.Session SummaryIn this edition of the Hope Drop, we dive into a thought-provoking conversation with Dr. Ariel Zeleznikow-Johnston, neuroscientist and author of The Future Loves You: How and Why We Should Abolish Death. Ariel explores the science and philosophy of brain preservation, questioning long-held beliefs about life, death, and personal identity. We explore how neuroscience might redefine what it means to truly live—and challenge assumptions around mortality.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm.Molly MacKinlay | New Decentralized Mechanisms for Funding Public Goods
14:19||Season 1Molly Mackinlay has extensive work experience in various roles at different companies. She is currently the Head of Engineering, Product, & Research Development at Protocol Labs, where they lead teams working on the IPFS Project. Prior to this, Molly worked at Google where they held multiple roles including Google Search PM II, Google Forms PM, Google Classroom PM, and Associate Product Manager for Chrome Native Client. Before joining Google, she obtained their Bachelor's degree in Computer Science with a concentration in Human Computer Interaction from Stanford University. Key HighlightsExplores decentralized mechanisms for funding public goodsPresents three web3 experiments: Quadratic Funding, DAO treasuries, and Retroactive Public Goods RewardsIntroduces Open Impact Foundation as a legal structure for public goods fundingAbout Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Anders Sandberg | Whole Brain Emulation Ethics
12:07||Season 1Anders Sandberg's research centres on estimating the capabilities and underlying science of future technologies, methods of reasoning about long-term futures, existential and global catastrophic risk, the search for extraterrestrial intelligence (SETI), as well as societal and ethical issues surrounding human enhancement.Topics of particular interest include management of systemic risk, reasoning under uncertainty, enhancement of cognition, neuroethics and public policy. He has worked on this within the EU project ENHANCE, where he was also responsible for public outreach and online presence, and the ERC UnPredict project.Besides scientific publications in neuroscience, ethics and future studies he has also participated in the public debate about human enhancement, existential risk and SETI internationally.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Barbara Diehl | Innovation and Funding Mechanisms at SPRIND
14:06|Barbara Diehl is a proven expert in entrepreneurship, innovation and education and has been facilitating partnerships with science and business at SPRIND since 2020. Prior to joining SPRIND, she had a successful career in the UK and Ireland for 10 years at the Oxford University Entrepreneurship Centre and the Innovation Academy at University College Dublin. In Oxford, she led early-stage investment programs and an executive education program for fast-growing small businesses (Goldman Sachs 10,000 Small Businesses growth program). Key highlights:The work of SPRIND: an initiative by the German government to develop breakthrough innovations, priority areas being circular biome manufacturing, antivirals, long-duration energy storage, and tissue engineering. Plans to improve data availability and advocate for policy changes within universities. The importance of mutual discovery between the US and European innovation ecosystems. The need for flexible and agile funding mechanisms and people funding rather than project funding.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.30. Existential Hope Podcast: Eli Dourado, Abundance Institute | Accelerating Progress
53:37||Season 2, Ep. 30Eli Dourado is the Chief Economist at the Abundance Institute. He is a former Senior Research Fellow at the Mercatus Center at George Mason University and he has studied and written about a wide range of technology policy issues, including Internet governance, intellectual property, cybersecurity, and cryptocurrency.Session SummaryThis episode covers topics including Dourado’s efforts to accelerate economic growth in the U.S., his views on policy reforms in key sectors such as health, housing, energy, and transportation, and the challenges of regulatory complacency. We also explore the potential of new technologies such as AI and biotechnology. Dourado shares his vision of a future with scalable healthcare solutions, more efficient housing, rapid deployment of energy technologies, and advancements in transportation like supersonic flights and electric vehicles. The conversation concludes on the importance of broad literacy and continuous writing in supporting progress.Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm.Gustavs Zilgavis | The Path to Mars Governance
09:27|Gustavs Zilgalvis is a technology and security policy fellow within RAND's Global and Emerging Risks Division, a Ford Dorsey Master's in International Policy candidate at Stanford's Freeman Spogli Institute for International Studies, and a founding Director at the Center for Space Governance. At RAND, he is specializing in the geopolitical and economic implications of the development of artificial intelligence. Previously, Zilgalvis has written about the interface of space and artificial intelligence in Frontiers of Space Technology, held a Summer Research Fellowship on artificial intelligence at Oxford's Future of Humanity Institute, and his research in computational high-energy physics has appeared in SciPost Physics and SciPost Physics Core. Zilgalvis holds a Bachelor of Science with First-Class Honors in Theoretical Physics from University College London, and graduated first in his class from the European School Brussels II.About Foresight InstituteForesight Institute is a research organization and non-profit that supports the beneficial development of high-impact technologies. Since our founding in 1987 on a vision of guiding powerful technologies, we have continued to evolve into a many-armed organization that focuses on several fields of science and technology that are too ambitious for legacy institutions to support.Allison DuettmannThe President and CEO of Foresight Institute, Allison Duettmann directs the Intelligent Cooperation, Molecular Machines, Biotech & Health Extension, Neurotech, and Space Programs, alongside Fellowships, Prizes, and Tech Trees. She has also been pivotal in co-initiating the Longevity Prize, pioneering initiatives like Existentialhope.com, and contributing to notable works like "Superintelligence: Coordination & Strategy" and "Gaming the Future".Get Involved with Foresight:Apply to our virtual technical seminars Join our in-person events and workshops Donate: Support Our Work – If you enjoy what we do, please consider this, as we are entirely funded by your donations!Follow Us: Twitter | Facebook | LinkedInNote: Explore every word spoken on this podcast through Fathom.fm, an innovative podcast search engine.Amanda Ngo | Innovating With AI for Wellbeing
48:07||Season 2SpeakerAmanda Ngo is a 2024 Foresight Fellow. Recently, she has built Elicit.org from inception to 100k+ monthly users, leading a team of 5 engineers and designers, presented on forecasting, safe AI systems, and LLM research tools at conferences (EAG, Foresight Institute), ran a 60-person hackathon with FiftyYears using LLMs to improve our wellbeing (event, write up), analyzed Ideal Parent Figure transcripts and built an automated IPF chatbot (demo), and co-organized a 400-person retreat for Interact, a technology for social good fellowship.Session Summary“Imagine waking up every day in a state of flow, where all the knots and fears are replaced with a deep sense of ease and joy.”This week we are dropping another special episode of the Existential Hope podcast, featuring Amanda Ngo, a Foresight Institute Existential Hope fellow specializing in AI innovation for wellbeing. Amanda speaks about her work on leveraging AI to enhance human flourishing, sharing insights on the latest advancements and their potential impacts. Her app: https://www.mysunrise.app/Full transcript, list of resources, and art piece: https://www.existentialhope.com/podcastsExistential Hope was created to collect positive and possible scenarios for the future so that we can have more people commit to creating a brighter future, and to begin mapping out the main developments and challenges that need to be navigated to reach it. Existential Hope is a Foresight Institute project.Hosted by Allison Duettmann and Beatrice ErkersFollow Us: Twitter | Facebook | LinkedIn | Existential Hope InstagramExplore every word spoken on this podcast through Fathom.fm.