Objective estimation of body condition score by modeling cow body shape from digital images

Body condition score (BCS) is considered an impor- tant tool for management of dairy cattle. The feasibil- ity of estimating the BCS from digital images has been demonstrated in recent work. Regression machines have been successfully employed for automatic BCS estima- tion, taking into account information of the overall shape or information extracted on anatomical points of the shape. Despite the progress in this research area, such studies have not addressed the problem of model- ing the shape of cows to build a robust descriptor for automatic BCS estimation. Moreover, a benchmark data set of images meant as a point of reference for quantitative evaluation and comparison of different automatic estimation methods for BCS is lacking. The main objective of this study was to develop a technique that was able to describe the body shape of cows in a reconstructive way. Images, used to build a benchmark data set for developing an automatic system for BCS, were taken using a camera placed above an exit gate from the milking robot. The camera was positioned at 3 m from the ground and in such a position to capture images of the rear, dorsal pelvic, and loin area of cows. The BCS of each cow was estimated on site by 2 techni- cians and associated to the cow images. The benchmark data set contained 286 images with associated BCS, anatomical points, and shapes. It was used for quan- titative evaluation. A set of example cow body shapes was created. Linear and polynomial kernel principal component analysis was used to reconstruct shapes of cows using a linear combination of basic shapes con- structed from the example database. In this manner, a cow’s body shape was described by considering her variability from the average shape. The method pro- duced a compact description of the shape to be used for automatic estimation of BCS. Model validation showed that the polynomial model proposed in this study per- forms better (error = 0.31) than other state-of-the-art methods in estimating BCS even at the extreme values of BCS scale.