Share

cover art for This alternative way to measure research impact made judges cry with joy

Working Scientist

This alternative way to measure research impact made judges cry with joy

The UK’s Research Excellence Framework (REF) collects research outputs from UK universities and is used by the the country’s government to distribute around £2 billion in research funding. But its focus on publications to measure outputs has drawn criticism. 


The Hidden REF, set up in 2020, looks at alternative measures. Simon Hettrick, its chair and director of the Software Susaintability Institute at the University of Southampton, UK, explains what can be submitted, and why publications are excluded. 


Gemma Derrick, a former member of the Hidden REF advisory committee who studies research policy and culture at the University of Bristol, UK, talks about its “hidden roles” category, and why some entries moved judges to tears. 


Kevin Atkins, who has worked as a site engineer at the University of Plymouth’s Marine Biological Association for 32 years, was highly commended in the category. He describes a typical day, and how his work contributes to the wider research enterprise.


Another highly commended entry was Growing up on the Streets, an international co-produced research project led by the University of Dundee, which focuses on around 200 young people aged 14 to 20 across three African cities: Accra, Bukavu and Harare. 


Lorraine van Blerk, a human geography researcher at the university, explains how six young people in each city were recruited as researchers, and how their roles were recognised and celebrated.

More episodes

View all episodes

  • How artificial intelligence can help to keep us safe

    30:44|
    Growing up in the last years of the Cold War motivated Gabriele Jacobs to enter academia and play her part in building peaceful societies. Jacobs works at Erasmus University Rotterdam in the Netherlands, where she researches the role artificial intelligence (AI) can play in public safety and the ethical debate surrounding this.She describes how experiments are being conducted on beaches in the Netherlands to see if AI can be used to predict human behaviour. These experiments also test the ethical, legal and social implications of this use of AI, and question who has the power to choose the definitions used in the algorithms.  Jacobs’ work addresses Sustainable Development Goal Number 16: to promote peaceful and inclusive societies and justice for all. This is episode 16 of How to Save Humanity in 17 Goals, a Working Scientist series podcast that profiles scientists whose work addresses one or more of the SDGs.   Episodes 13–18 are produced in partnership with Nature Sustainability, and introduced by Monica Contestabile, its chief editor.
  • My mission to protect threatened mangroves

    25:19|
    Sigit Sasmito describes how his research at James Cook University in Brisbane, Australia, is helping to protect both peatlands and mangroves across southeast Asia, as part of a drive to meet Sustainable Development Goal 15.The goal, one of 17 agreed by the United Nations in 2015. aims to protect, restore and promote sustainable use of terrestrial ecosystems. This includes sustainable forest management, combating desertification, and halting biodiversity loss.Indonesia, where Samito grew up, aims to restore 1.2 million hectare of peatlands and 600,000 hectares of mangroves, he tells How to Save Humanity in 17 Goals podcast series. Ultimately these efforts must involve local communities and needs to deliver benefits for them, he says.
  • How studying octopus nurseries can shape the future of our oceans

    31:12|
    Watching documentaries about the Titanic inspired deep-sea microbiologist Beth Orcutt to study life at the bottom of the ocean - a world of ‘towering chimneys, weird shrimp and octopus nurseries’ that she has visited 35 times.But Orcutt says there is so much we still don't know about the deep sea, which is a problem for the sustainable development of this environment. Orcutt works at Bigelow Laboratory for Ocean Sciences in Boothbay, Maine, where her research helps to understand how deep-sea mining might impact unique ocean communities.Research on similarly destructive activities, such as deep-sea trawling, show decades-long recovery times for keystone species such as corals and sponges, or in some cases no recovery at all.Orcutt works through the Crustal Ocean Biosphere Research Accelerator (COBRA) project funded by the US National Science Foundation to bring academics, policymakers and science communicators together to accelerate research about the deep sea and translate that knowledge for decision makers.This is episode 14 of How to Save Humanity in 17 Goals, a Working Scientist series podcast that profiles scientists whose work addresses one or more of the SDGs. Orcutt's work addresses Sustainable Development Goal number 14: to conserve and sustainably use the oceans, seas and marine sources.Episodes 13–18 are produced in partnership with Nature Sustainability, and introduced by Monica Contestabile, its chief editor.This episode ends with a sponsored slot from La Trobe Institute for Sustainable Agriculture and Food in Melbourne, Australia, where we hear about how its researchers are focusing on the SDGs and the university’s holistic approach to food security.
  • How we slashed our lab’s carbon footprint

    24:09|
    Analytical chemist Jane Kilcoyne was working in her biotoxin monitoring lab one day in 2018 when she noticed a bin overflowing with plastic waste. The observation prompted her to join forces with like-minded colleagues and develop a package of measures aimed at reducing their lab’s carbon footprint. Their efforts include reducing energy consumption, composting shellfish waste, polystyrene recycling, and digitizing documentation. Labs are estimated to use 10 times more energy and five times more water than office spaces, she says, and the average bench scientist uses around 10 times more single-use plastics than the average person. Kilcoyne, who works at the Marine Institute, a government agency responsible for marine research, in Galway, Ireland, describes how their efforts feed into the thirteenth of 17 Sustainable Development Goals set by the United Nations in 2015 (to take urgent action to combat climate change and its impacts). How to Save Humanity in 17 Goals is a podcast series that profiles scientists whose work addresses one or more of the SDGs. Episodes 13–18 are produced in partnership with Nature Sustainability, and introduced by Monica Contestabile, its chief editor.
  • Meet the retired scientists who collaborate with younger colleagues

    19:18|
    In the sixth and final episode of The Last few miles: planning for the late stage career in science, Julie Gould unpicks some of the generational tensions that can arise in academia when a colleague approaches retirement.Inger Mewburn, who leads research and development training at the Australian National University in Canberra, tells her: “There’s a fine line between being around and being valued, to being around and kind of being a pain in the ass and no one will tell you to go away.”Gould also talks to scientists who, despite reaching retirement age, continue to engage with younger colleagues, enjoying positive interactions at conferences and co-authoring papers.They include Heather Middleton, who started trawling England’s Jurassic Coast in her 60s, looking for specimens that might lead to a deeper understanding of palaeontology. Middleton, who is approaching her 80th birthday, taught science in schools and colleges, and in retirement balances her fossil-hunting, (and the collaboration opportunities it brings), with family holidays, grandchildren, friends and Tai Chi. "It’s a great balance, which I hope other retiring scientists will be able to enjoy such opportunities that I’ve had," she says.
  • A dumpster full of mercury and other things to avoid: lab closures made simple

    23:02|
    In the fifth episode of this six-part podcast series about the late career stage, physicist María Teresa Dova outlines how she is preparing colleagues years in advance to ensure a smooth handover of her lab at the University of La Plata, in Argentina.But in the United States, when the principal investigator leaves it is likely the lab itself will close down, Gould discovers. For microbiologist Roberto Kolter, emeritus professor at Harvard Medical School in Boston, Massachusetts, this meant gradually downsizing his team before retirement, so all members had a clear timeframe in which to finish their work.Often what happens to the contents of a lab is decided by the institution. Equipment such as freezers are often given to other research groups, while unique resources — such as Kolter’s 10,000 strong collection of bacterial strains created from his years of research — are kept and managed by the institution.Chemist Craig Merlic, executive director of the University of California Center for Laboratory Safety in Los Angeles, stresses that it is important to think about the fate of hazardous lab materials to prevent future accidents.Sometimes there isn’t time to plan, as experienced by immunologist Carol Shoshkes Reiss at New York University, when she had to suddenly close her lab due to a lack of funds. Shoshkes Reiss shares the surprising feeling she experienced after this abrupt closure — relief.
  • Pension planning and psychosocial support: how institutions can help academics at the late career stage

    23:05|
    The list of things to organize as retirement from academia approaches can feel daunting. In the fourth episode of The last few miles, a six-part podcast series about the late career stage in science, researchers talk about health, housing and financial planning.Carol Shoshkes Reiss, an immunologist at New York University, explains how her institution assigns individual wealth managers to advise on retirement investments and budgeting.Inger Mewburn, who leads researcher training at the Australian National University in Canberra, chose a private accountant to manage her finances, who probes not only her approach to risk around investments, but also potential retirement dates and her income expectations.Entomologist Matan Shelomi, associate professor at the National Taiwan University in Taipei and originally a citizen of the United States, describes how he has had to amend his retirement plans as an expat academic.Gerontologist Stacey Gordon works with Shoshkes Reiss at New York University as part of a personalised program to support individuals with the mental and social aspects of their retirement, helping colleagues to find purpose and meaning in retirement.
  • “Who am I if not a scientist?” How to find identity and purpose in retirement

    19:29|
    Because many scientists see their career as a calling, when retirement arrives it can bring with it feelings of insecurity and worry about what this means for them.Microbiologist Roberto Kolter, emeritus professor at Harvard Medical School, Massachusetts, is keen to show others that retirement is a joyous time and a chance to broaden one’s scientific area of interest. It can also bring with it new speaking and travel opportunities.Experimental physicist Athene Donald is soon to complete a 10-year stint as master of Churchill College at Cambridge University in the United Kingdom. Donald tells Gould how she is handling the nervousness that comes with the arrival of a second retirement phase, and what she is doing to balance continued involvement in academia with the slower pace of life.Inger Mewburn, who leads research training at the Australian National University in Canberra, and Pat Thompson, education researcher at the University of Nottingham, United Kingdom, acknowledge how hard it can be to give up something that has given you purpose and drive for so many years.Some, such as Thompson, have developed hobbies alongside their working careers that they are looking forward to doing more as they step back from academia. Both Mewburn and Thompson agree that an important part of the process is figuring out which parts of your working identity, such as writer or educator, you want to carry through to retirement.This is the third episode of the six-part podcast series: The last few miles: planning for the late-stage career in science.
  • Choose your own adventure: navigating retirement after an academic career

    20:12|
    The idea that retirement marks the end of employment and the beginning of a life of leisure is one that many academics feel is outdated.Roger Baldwin, a retired researcher of higher education at Michigan State University in East Lansing and chair of the US Association of Retirement Organizations in Higher Education (AROHE), a membership organization based in Los Angeles, California, describes it instead as “an open ended period after one’s main professional employment that has almost infinite potential opportunities” — academic or otherwise.Some take on the role of an emeritus professor, an honorary title that grants the holder continued involvement with their university. Shirley Tilghman, a molecular biologist and emeritus professor at Princeton University in New Jersey, continues to serve on university boards and advise on science policy.Carlos García Canal, a physicist at the University of La Plata in Argentina, took the emeritus title after forced retirement 15 years ago (aged 65) so that he could continue teaching at the institution.An alternative option for academics is an adjunct professorship, which human molecular biologist and geneticist Juergen Reichardt selected. It enables him to continue in a research role at the Australian Institute of Tropical Health and Medicine at James Cook University in Townsville, Australia.It can be difficult deciding whether to continue with a role in academia after retiring or to switch to something different. Health and family considerations can have a big impact on this decision. As Baldwin explains, it can be hard to balance the freedom and flexibility offered by retirement with continued academic commitments.