2D and 3D analysis of animal locomotion from biplanar X-ray videos using augmented active appearance models
- PDF / 1,219,708 Bytes
- 13 Pages / 595 x 794 pts Page_size
- 35 Downloads / 152 Views
RESEARCH
Open Access
2D and 3D analysis of animal locomotion from biplanar X-ray videos using augmented active appearance models Daniel Haase* and Joachim Denzler Abstract For many fundamental problems and applications in biomechanics, biology, and robotics, an in-depth understanding of animal locomotion is essential. To analyze the locomotion of animals, high-speed X-ray videos are recorded, in which anatomical landmarks of the locomotor system are of main interest and must be located. To date, several thousand sequences have been recorded, which makes a manual annotation of all landmarks practically impossible. Therefore, an automatization of X-ray landmark tracking in locomotion scenarios is worthwhile. However, tracking all landmarks of interest is a very challenging task, as severe self-occlusions of the animal and low contrast are present in the images due to the X-ray modality. For this reason, existing approaches are currently only applicable for very specific subsets of anatomical landmarks. In contrast, our goal is to present a holistic approach which models all anatomical landmarks in one consistent, probabilistic framework. While active appearance models (AAMs) provide a reasonable global modeling framework, they yield poor fitting results when applied on the full set of landmarks. In this paper, we propose to augment the AAM fitting process by imposing constraints from various sources. We derive a general probabilistic fitting approach and show how results of subset AAMs, local tracking, anatomical knowledge, and epipolar constraints can be included. The evaluation of our approach is based on 32 real-world datasets of five bird species which contain 175,942 ground-truth landmark positions provided by human experts. We show that our method clearly outperforms standard AAM fitting and provides reasonable tracking results for all landmark types. In addition, we show that the tracking accuracy of our approach is even sufficient to provide reliable three-dimensional landmark estimates for calibrated datasets. Keywords: Active appearance models; X-ray videography; Landmark tracking; Animal locomotion analysis
1 Introduction For many fundamental problems of ongoing research in biomechanics, zoology, evolutionary biology, and robotics, the key element is a thorough knowledge on animal locomotion [1-8]. Ideally, this knowledge is obtained by analyzing skeletal movements of locomoting animals. While many methods have been developed over time, the state-of-the-art approach for obtaining noninvasive in vivo measurements of the locomotor system is biplanar X-ray videography. In contrast to reflective markerbased methods, it allows for unobstructed observations at an unrivaled accuracy [5]. In general, the animal to *Correspondence: [email protected] Computer Vision Group, Friedrich Schiller University of Jena, Ernst-Abbe-Platz 2-4, Jena 07743, Germany
be analyzed is placed on a treadmill and filmed from a side camera view (lateral camera) and a top camera view (dorsoventral camera) at a very high frequen
Data Loading...
