Deep Learning for Marine Mammal Bioacoustics

Thomas Webber

Scottish Association for Marine Science

In Autumn (Fall) of 2024 I left sunny Scotland and headed across the Atlantic to one of the best ornithology labs in the world. On the surface, this seems like a rouge choice of labs to visit, given I specialise in marine mammal acoustics. The Cornell lab of Ornithology however is home to the K. Lisa Yang Center for Conservation Bioacoustics (https://www.birds.cornell.edu/ccb/). This centre outputs some impressive cutting-edge research surrounding the use of sound to study the ecology of vocal animals. From birds and insects, to elephants and whales. This cutting-edge research includes the use of deep learning to process enormous acoustic datasets to find animal vocalisations.


My own PhD aims to use deep learning in a similar way. The goal being to find the vocalisations of Risso’s dolphins from a large network of underwater microphones (compass-oceanscience.eu), in a dataset that would take over 10 years to listen to in real time. I came to the lab with a deep learning model I (very much a biologist) had developed, ready to test and break it with the hope of improving the model before its deployment.

I was welcomed into the centre and immediately introduced to other researchers who are interested in big marine datasets with the goal of also identifying vocalisations down to the species level. I was fortunate enough to be given access to these large datasets to compare how my model, trained on data from the north-east Atlantic performed on data from the north-west Atlantic and the north-east Pacific. Both these new datasets contain different species, and potentially different vocalisations even from the same species. I was able to learn and compare different methods in signal processing to be able to answer this seemingly simple question of what animal makes that noise.


After testing the model on new data and working with others at the lab to improve the model, I have now started running the model through its primary use case, the COMPASS dataset. While I have greatly enjoyed my dive into deep learning, I am looking forward to jumping back into using these outputs to study the ecology of Risso’s dolphins in Scottish waters.

Before I made the jump back to ecology however, I was fortunate enough to be introduced to Maha Assarzadeh based at the University of Chemnitz. Maha specialises in explaining how typically ‘black box’ deep learning models make their decisions and was able to help me apply a method known as occlusion-based saliency mapping to my own model, allowing us to gain a deeper insight into how the model works.

This was not only my first trip to Ithaca, but my first to the United States. So, when I could, I made full use of my time, making sure to do as much sightseeing as possible. I was fortunate enough to be alongside several other visiting PhD students, exploring lots of waterfalls, forests and lakes.


I am extremely grateful to the Challenger Society for their contribution to make this visit to the Cornell Lab of Ornithology possible. I have not only improved my own knowledge and the outputs for the PhD, but I have also been fortunate enough to meet some inspiring researchers, both those who are well established and those just starting out in their career.

Profile:
I am a marine ecologist with a keen interest in using acoustics to study marine mammals. Currently pursuing my PhD, my research focuses on investigating the occurrence of Risso's dolphins along the west coast of Scotland by employing passive acoustic monitoring. I am developing a deep learning classifier to detect Risso's dolphin vocalizations within a large acoustic dataset, which will enable me to model their distribution patterns. A key objective of my work is to provide policymakers with evidence-based recommendations for effective monitoring and management strategies to protect Risso's dolphins in Scottish waters.

Latest News

NOC Association (NOCA) AGM 2025


The 14th AGM of the NOC Association will be held on Thursday 15th and Friday 16th May 2025. This free, on-line event will take place on Zoom, across two consecutive mornings, each starting at 10:00 and ending at 12:30. The agenda will focus on national capability (NC) science, ships, and autonomous vehicles, and how the community can engage. There will be an update on AtlantiS and on the new marine science scoping group. All are warmly welcome to join.

To participate, please complete your registration here.

For enquiries: Jackie Pearson, Secretary to NOCA: jfpea@noc.ac.uk

Read More


Townhall on UK Arctic Ocean contribution to International Polar Year 32/33

 
SAVE THE DATE
12:00 11th June – 16:00 12th June 2025
NOC Southampton

The Arctic is one of the most rapidly-changing regions on our planet, with impacts on global sea-level rise, changes to our climate and weather patterns, and threats to our shared biodiversity and ecosystem services. With the international community rapidly mobilising towards the International Polar Year 32/33, and with new international programmes and initiatives now being shaped, it is timely for the UK Ocean Science community to come together and articulate what its unique offerings could be to Arctic research and technology.

This hybrid 2-day meeting, to be held at NOC Southampton, is intended to start this process. Recognising the Arctic Oceans role in global Earth and Human systems, anticipated outcomes include a high-level shaping of what the UK Arctic Ocean community would like to achieve over the course of the IPY, stimulation of new collaborations and proposals for grand Arctic challenges and a baseline from which wider integration with terrestrial, atmospheric and cryosphere communities, both in the UK and overseas, can be built.  Discussions will continue in diverse forums, including the UK Arctic Science Meeting in September and at Challenger 2026.

This action is supported by the UK Arctic Office and UK Arctic and Antarctic Partnership

Further details and meeting registration link will be circulated in April together with a questionnaire to help shape the agenda and discussion

In the meantime…SAVE THE DATE

Read More


Potential Availability of NERC Ship Time During the 25/26 Programme Year

The NERC Marine Facilities Programme for 2025/2026 for the RRS Discovery and the RRS James Cook has been published on the Marine Facilities Planning website.

The RRS Discovery programme currently contains a 79 day alongside slot between the 2nd of November 2025 and the 19th of January 2026, which is available for science delivery if funded science projects can make use of this time. Due to the location of the vessel, the ship is most likely to be able to deliver fieldwork in the North and East Atlantic regions. Some support for science capability within the National Marine Equipment Pool is potentially available, although there is no capacity for use of autonomous vehicles or remotely operated vehicles. Any fieldwork within Exclusive Economic Zones (EEZs) will need the appropriate diplomatic clearance submitted to coastal states at least 6 months in advance, and to NMF with sufficient lead time for processing via the FCDO.

If interested in making use of this ship time, please contact NERC Marine Planning (marineplanning@nerc.ukri.org) ASAP to start discussions.

Read More