A New Study discussing the reliability of visual breed identification

In a new study that was just released, researcher Victoria Voith once again exposes the challenges of identifying dominant breeds of mixed breed dogs, even by "experts" in the field.  I think the research is important for a lot of reasons (some different from what others have surmised), and worth reviewing as the world of DNA genetics testing continues to challenge what we think we know about canine genetics, and rapidly adding knowledge to the field.

The Study

In the study, more than 900 people who had professions in the field of animal welfare were asked to watch a 1 minute video of 20 dogs that showed the full view of the front and side of the dog, along with the weights, age, and sex of the dogs. All participants noted that they're breed identification was sometimes used for record keeping purposes and were largely made up of kennel staff, Veterinary Assistants, Animal control Field officers, dog trainers, or other animal control or veterinary/behavior triaining staff.

The survey participants then had to answer the following questions:

Do you think the dog is purebred?  yes/no

If yes, what breed to you think it is?

If No, what do you think is the most predominant breed?

What do you think is the second most predominant breed? If you are unsure, write "mix".

The answers were then compared to the DNA results for the dogs.

The Dogs

Before I get into the results for this, I want to discuss the dogs used, and DNA as a whole. It's very important to note that at this point no one is saying that DNA tests are 100% reliable. Even the researchers who are creating the tests note this. Currently, the Mars Wisdom Panel test (which was used for this analysis) says it has a 90% accuracy rate across all first generation crosses. As dogs get further removed from pure heritage, the results get less and less accurate.

It's very important to note in this study that only ONE of the 20 dogs used came back with 50% or more of any one breed -- so only ONE fell within the 90% accuracy range. So, essentially,we cannot have a lot of certainly of the actual DNA results of almost any of the dogs in the study.  However, with the other 19, we can be 90% certain that the really are very mixed breed dogs and not predominently any one breed.  I think this is very important in how the results are analyzed.

The Results

While this study is far from conclusive because of the very small sample set of dogs, I do believe the initial results are very interesting.

Based on the study results, for 7 of the 20 dogs, more than 10% of the responents thought that the dog was "probably" a purebred dog. For three of the 20, 19% or more of the respondents thought the dog was probably a purebred dog (one of these three was the only dog in the study with a mix of 50% of any one breed - Miniature Pincher - and the majority of respondents incorrectly ID'd the dog as predominently Carin Terrier). 

Also of note, there was agreement among 50% or more of the respondents in the predominent breed in only 7 of the dogs -- and in 3 of them, the visual ID did not match ANY of the DNA identification. In the other 13 dogs (65%) there was no majority guess among the panel.

In 14 of the 20 dogs used, less than half of the guesses included a breed that was even detected by the DNA results. And for one of the dogs, exactly zero of the 859 respondents correctly identified a breed of dog in the mix (and this was the dog with highest breed concentration). 

Discussion

It's important to note why this data is important. In the United States, more than 40% of the canine population is mixed breed. 

For decades, the only possible way to identify mixed breed dogs was through visual identification, and many city juristictions have used such identification to influence their animal control policies.

However, we are now getting a lot of science-based data on the efficacy of such ideals, and the results don't support visual breed ID as a basis for policy:

- Visual ID of dogs is highly inaccurate when compared to DNA results

- The Visual ID of mixed breed dogs is highly subjective, as most 'experts' don't agree on the breeds based on looks

- Even those well-educated in the field are susceptible to judgment biases

Thus, statistical data that has often used to promote breed-specific policies is, and has been, based on visual breed identification that is proving itself to be highly subjective and inaccurate. And if public policy-makers want to rely on scientific and accurate information for their decisions, then the best solution will be to focus solely on behavior-based ordinances that target how dogs (and owenrs) BEHAVE, not how they look. 

Here's a link to the entire Voith Study (very detailed)

Here's a link to the National Canine Research Council's overview of the study.

Here's a link to a very nice visual chart that shows the dogs and the study results for the dogs.

Comments

[Selma]

My question is much more simple than that: Where is the evidence that DNA testing works in MIXED BREED dogs?

Hint: To date, there is none [that I can find, still looking, always looking].

There is some accuracy in purebreds but testing has been very limited.

[BorderWars]

I have yet to see any of these Dog DNA tests actually TESTED themselves against known dogs of known heritage. They can't be used (and they state this themselves) to identify purebreds. Why would this be?

An derivative study like this would be interesting if the actual DNA tests were anywhere near accurate. But so far I see no evidence that they provide ANY insight. And I'm a big fan of DNA and dogs.

I think they are, at this point, just a scam. So this entire analysis, rather premature and indicative of nothing.

You can't really cross-examine visual identification methods if the DNA test itself hasn't been proven accurate.

[Brent]

BW -- I think it's important to note that the accuracy of the DNA test itself is not important to support the overall conclusion. The conclusion is that visual identification is not accurate --- and can be derived at through the reality that visual identification varies greatly from person to person. So we know, beyond a shadow of a doubt that visual ID of mixed breed dogs is very much in the eye of the identifier. I think DNA testing has a lot of promise to change this in the future. I think that in it's current form is is more reliable than a "scam". But the conclusion that visual ID is not reliable is found true in this case whether the DNA is accurate or not.

[melliroth]

I certainly like animals, especially dogs. They are cute.
Here is a link https://www.khanacademy.org/

[JAMES WELL]

Thanks for the discussion

[oliver]

It is now the high time to treat animal as the essential part of human lives. Not only using them for human benefit but also helping them to get a good life.
https://eduhelphub.com/