Improving deep learning based bluespotted ribbontail ray (Taeniura Lymma) recognition

Avivit Levy, Adi Barash, Chen Zaguri, Ariel Hadad, Polina Polsky

Research output: Contribution to journalArticlepeer-review

Abstract

This paper presents the novel task of bluespotted ribbontail (BR) ray (Taeniura lymma) recognition using deep learning based computer vision methods to enable the identification of specific individuals of this species. Mapping the specific individuals in relation to location and time will allow marine researchers to understand their movement patterns, habitat choice, life span, size of the population and more – data which could allow monitoring and establishing a tailor-made conservation plan for this species. Our work is pioneer on this recognition problem. We give a detailed description of the three basic steps of detection, feature extraction and recognition in this vision problem and perform experiments to explore the system configuration and what improves the performance. A feature extraction enhancement as well as a crucial effect of a split into different main poses are demonstrated. Though the precision results achieved in this paper are still moderate and should be further improved, they are nevertheless promising and reasonable for practical use if the six best matches are chosen. For this scenario, almost 85% precision for upper-pose model, and almost 80% precision for left- and right-pose models, are achieved demonstrating the feasibility of the pipeline suggested as well as opportunities for improvement.

Original languageEnglish
Article number102737
JournalEcological Informatics
Volume82
DOIs
StatePublished - Sep 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2024 The Author(s)

Keywords

  • Citizen science
  • Computer vision
  • Ecological study
  • Marine animal recognition
  • Pose handling

ASJC Scopus subject areas

  • Ecology, Evolution, Behavior and Systematics
  • Ecology
  • Modeling and Simulation
  • Ecological Modeling
  • Computer Science Applications
  • Computational Theory and Mathematics
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Improving deep learning based bluespotted ribbontail ray (Taeniura Lymma) recognition'. Together they form a unique fingerprint.

Cite this