itsfm, an open-source package to reliably segment and measure sounds by frequency modulation
Beleyur, T.
Show abstract
Analysing animal vocalisations in detail provides insights into the biomechanics, decision making and sensory processes behind their behaviours. Echolocating bats, and in particular, the CF-FM calls of high-duty cycle bats serve as a convenient model system to illustrate this point. The CF component in the CF-FM call is used for prey detection and the FM component is used in target ranging. According to the behavioural context at hand such as flight with conspecifics or prey capture, bats choose to increase the duration, intensity or spectral range of the components differently. Studying the call component alterations requires an objective methodology that first segments the components and then allows measurements on them. Studies till now have segmented the call components manually, or automatically using what I term the peak-frequency method. Manual segmentation is error prone, while the peak-frequency method requires on-axis recordings for good results. Despite multiple papers using a peak-frequency based segmentation, there remain no publicly available software implementations. itsfm is an open-source package that fills this gap with two implemntations that can segment CF-FM calls, one of them being an implementation of the peak-percentage method. itsfm additionally introduces the pseudo-Wigner-Ville distribution (PWVD) method for call segmentation, thus allowing the segmentation of calls captured under a wider variety of recording conditions. I create a synthetic dataset and assess the performance of the PWVD method and the peak-frequency method. The PWVD performs consistently well in call component segmentation in comparison to the peak-percentage method. I also discuss the supporting methods in the itsfm package that can help the further automatic segmentation, measurement and analysis of sounds. Though originally developed for the segmentation and measurement of CF-FM bat calls, the methods in itsfm are speciesagnostic, and may be used for vocalisations of any type.
Matching journals
The top 3 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- DISCO: A deep learning ensemble for uncertainty-aware segmentation of acoustic signals 94%
- Assemblage of Focal Species Recognizers - AFSR: A technique for decreasing false positive rates of acoustic automatic identification in a multiple species context 94%
- Deep audio embeddings for vocalisation clustering 93%
Similar papers in this journal
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.