eCite Digital Repository

What are we measuring? Novices agree amongst themselves (but not always with experts) in their assessment of dog behaviour


Munch, KL and Wapstra, E and Thomas, S and Fisher, M and Sinn, DL, What are we measuring? Novices agree amongst themselves (but not always with experts) in their assessment of dog behaviour, Ethology, 125, (4) pp. 203-211. ISSN 0179-1613 (2019) [Refereed Article]

Copyright Statement

Copyright 2019 Blackwell Verlag GmbH

DOI: doi:10.1111/eth.12846


Humans differ in how they perceive, assess, and measure animal behaviour. This is problematic because strong observer bias can reduce statistical power, accuracy of scientific inference, and in the worst cases, lead to spurious results. Unfortunately, reports and studies of measurement reliability in animal behaviour studies are rare. Here, we investigated two aspects of measurement reliability in working dogs: inter-observer agreement and criterion validity (comparing novice ratings with those given by experts). Here, we extend for the first time a powerful framework used in human psychological studies to investigate three potential aspects of (dis)agreement in nonhuman animal behaviour research: (a) that some behaviours are easier to observe than others; (b) that some subjects are easier to observe than others; and (c) that observers with different levels of experience with the subject animal give the same or different ratings. We found that novice observers with the same level of experience agreed upon measures of a wide range of behaviours. We found no evidence that age of the dogs affected agreement between these same novice observers. However, when observers with different levels of experience (i.e., novices vs. a working dog expert) assessed the same dogs, agreement appeared to be strongly affected by the measurement instrument used to assess behaviour. Given that animal behaviour research often utilizes different observers with different levels of experience, our results suggest that further tests of how different observers may measure behaviour in different ways are needed across a wider variety of organisms and measurement instruments.

Item Details

Item Type:Refereed Article
Keywords:agreement, Canis familiaris, observer bias, personality, ratings
Research Division:Biological Sciences
Research Group:Ecology
Research Field:Behavioural ecology
Objective Division:Expanding Knowledge
Objective Group:Expanding knowledge
Objective Field:Expanding knowledge in the biological sciences
UTAS Author:Munch, KL (Ms Kirke Munch)
UTAS Author:Wapstra, E (Associate Professor Erik Wapstra)
UTAS Author:Sinn, DL (Dr David Sinn)
ID Code:143764
Year Published:2019
Web of Science® Times Cited:5
Deposited By:Zoology
Deposited On:2021-03-31
Last Modified:2021-06-30

Repository Staff Only: item control page