Puppy Love (and Statistics Stink)

In anticipation of the Supreme Court’s hearing Florida v. Harris, Penn State visiting assistant lawprof Erica Goldberg has written a pair of  interesting posts at Concurring Opinions. I leave the statistical analysis aspects to Goldberg and anyone else inclined to give it deep thought.  As a lawyer, I decline to engage in anything remotely resembling math unless it involves calculating my legal fee.

The aspect of Goldberg’s posts that I find intriguing is the perpetual and intentional avoidance of quantifying probable cause.

Courts consistently and expressly eschew technical conceptions of probable cause in order to provide police officers with flexibility to exercise their judgment in unfolding situations. In addition, courts focus on whether an officer has a reasonable belief that a suspect has committed or is committing a crime. This metric allows for probable cause to be found in situations where one reasonable officer might assess an 80% likelihood that a suspect is driving drunk, for example, even if another reasonable officer might think there is only a 40% likelihood. We might be tempted to assume the courts require that a reasonable officer be able to believe a crime has been committed by greater than a 50% likelihood, but this has not been made explicit.  All officers must prove to a court assessing a vehicle search is a reasonable ground for belief of guilt.  Further, when a court is making a probable cause determination for itself in determining if a warrant should issue, it must decide only if there is a “fair probability that contraband or evidence of a crime will be found in a particular place.”  What is a fair probability?

Granted, we would be deluding ourselves if we believed that under most circumstances, there could be a meaningful quantification of what constitutes probable cause. Sure, it wouldn’t kill the Supreme to use the ordinary definition of “probable,” as in more likely than not, but that might impair the flexibility of police officers to exercise their judgment, even though that makes probable cause sound particularly arbitrary.

Dogs, however, are entirely different.


In the context of drug detection dogs, where we have actual data on reliability, assigning a numerical value to probable cause — or at least to the maximum false positive percentage upon which an officer can rely — would add much needed clarity to Fourth Amendment law. It also does not undermine police officers’ ability to use their intuition, because the event precipitating a search is not an officer’s informed judgment, but the alert from a dog.

This assumes, of course, that the cops don’t bury the K-9 Officer Fluffy’s screw-ups and maintain legitimate records of every false-positive, false-negative, false-whatever.  It gives rise to some hard numbers, and that makes for some hard law.

At present, doggies are not only furry, friendly and cute as the dickens, but legally untouchable.  If a drug detection dog alerts, a big neon sign pops up screaming probable cause to search, and there’s nothing to be done about it.  The dog only gets it right 3.2% of the time? So what? It’s a dog, and the law loves dogs.

Then the Florida Supreme Court went and screwed it all up by applying basic reason to the myth, as in the expectation that before the Constitution is subject to the whims of a dog (or, for the sake of argument, it’s handler), a sufficient showing of reliability has to be made.  What a bunch of dog haters.


The Supreme Court may have granted cert in Harris to overturn what it considers an unduly burdensome evidentiary requirement on the police. However, if the Florida Supreme Court’s decision is upheld, the Supreme Court should decide numerically what maximum false positive rate can still yield probable cause, given the totality of the circumstances. The Court should not require the introduction of a dog’s false positive rate and then not advise lower courts on what rates are permissible to establish probable cause.  If out of 100 positive alerts to cocaine by a particular dog, the drug is found in only 50 of the cars, the Court should decide whether a police officer may search that car.

For all its efforts to avoid putting a number, a percentage, it may be hard to avoid this time.  The problem, of course, is that should the Supremes fix a percentage for dogs to suffice in establishing probable cause, there is no rational reason why it wouldn’t be applied to probable cause in general.

So what’s wrong with that?  Orin Kerr explains :


[C]ourts should not quantify probable cause because quantification would produce less accurate probable cause determinations. The core problem is that information critical to probable cause is often left out of affidavits in support of warrants: Although affidavits say what techniques police tried that added to cause, they generally leave out both what the police tried that did not add to cause and what techniques the police never tried. Determining probable cause accurately often requires this information, however. By leaving probable cause unquantified, current law enables judges to use their intuition and situation-sense to recognize when missing information is likely important to assessing probable cause. Quantification would lead to less accurate probable cause determinations by disabling those intuitions, creating the false impression that the information provided in the affidavit is the only relevant information. Cognitive biases such as the representativeness heuristic and anchoring effects would allow the government to create the false impression that a low-probability event was actually a high-probability event. To ensure accurate probable cause determinations, then, probable cause should remain unquantified. The result is counterintuitive but true: Knowing less about probable cause improves how the standard is applied.

While I admit that I can’t make any sense of this at all, it doesn’t stop me from disagreeing.  But then, I really don’t like dogs all that much and I like judges using “their intuition and situation-sense” to decide the scope and limits of constitutional rights even less. 

On the bright side, I have no expectation that the Supreme Court will affirm the Florida Supreme Court’s decision in Harris, making all of this a futile academic exercise. Instead, I anticipate a brief decision (perhaps written by Justice Thomas) to the effect that “dogs are cute and if something makes their cute little ears perk up, that’s good enough for us.”  No stats required.


Discover more from Simple Justice

Subscribe to get the latest posts sent to your email.

25 thoughts on “Puppy Love (and Statistics Stink)

  1. John Neff

    [C]ourts should not quantify probable cause because quantification would produce less accurate probable cause determinations.

    I see your problem how can one tell what the accuracy is without quantification.

    I know you do not permit links but Christopher Schipper has a “thou shalt not commit logical fallacies poster” that I think might be useful.

    [Ed. Note:  Here’s the link to the poster. Thanks John.]

  2. SHG

    Shoot me a link and maybe we can add the poster in. It sounds interesting.  I want to believe that Orin doesn’t indulge in logical fallacies (because I like and respect Orin, depsite our regular disagreements), but I’m having a great deal of trouble following his argument here.

  3. JMS

    Most judges seem to crib from Spider-Man. “Hmm, my Situation-Sense is tingling! Ever since I was bitten by a radioactive Guy Debord, I’ve learned that with great boilerplate comes great probability.”

    We CERTAINLY wouldn’t want to do anything that would create in the judge’s mind “the false impression that the information provided in the affidavit is the only relevant information.” Heavens no! Judicial skepticism of law enforcement has been the watchword, but it could all vanish if judges were told that dogs are only human.

    While it would be fun to watch the courts squirm over this stuff, I’m afraid that the outcome will be, in effect, a 99% error rate is still good enough for government work. And like you say, all the quantification requirement would do is give the cops incentive to fudge the dog’s grades.

  4. SHG

    The courts won’t squirm regardless. They’ll shrug, do as they always do, and be forced to come up with a better excuse.  Work, work, work.

  5. John Neff

    If a “drug dog” is right 50% of the time one can save a lot of money on dog food and vet bills by flipping a coin.

    I read an article by a dog trainer who said “drug dogs” were not much better than 50%. However he did not back up that claim with data.

    I think “drug dog” scores are strongly dependent on the dog handler.

  6. Michael Drake

    “While I admit that I can’t make any sense of this at all…”

    Let me see if I can help. Magistrates—who as Orin himself has noted* “typically have not been legal scholars” or “even lawyers,” and are not required to have “any legal training”—are nonetheless able to intuit the existence of any and all facts outside the four corners of the affidavit necessary for a finding of probable cause. This ability would be impeded if the notionally operative legal standard were made unduly clear.

    I hope that helps.

    *http://volokh.com/2011/06/23/the-historical-role-of-warrants-particularity-and-magistrates/

  7. Onlooker

    Don’t hate the dog! Hate the people who use them for their own agenda and purposes!

    Hopefully this case will at least get peoples’ ears perked up a bit and make them think about the veracity of the whole drug dog method (myth). One can hope.

  8. SHG

    What makes this all the more remarkable (and silly) is that if probable cause is no better than a flip of the coin, why are we wasting all this time and effort on trying to create doctrinal excuses for undermining the Fourth Amendment?

  9. Frank

    Far as I’m concerned, any cop that can’t define “Clever Hans Effect” on the stand and testify to training and operations used to eliminate same should be put in the same category as cops who lie on the stand.

  10. Jill McMahon

    “Situation-sense” = ESP (extra-statistical perception). I was flummoxed by Kerr’s argument too, although it sounds vaguely like the pornography-I-know-it-when-I-see it non-argument.
    (Belatedly– glad you’re back, Scott.)

  11. SHG

    Thanks, Jill. I suppose Orin has a faith in judges that no lawyer outside the employ of the government shares.

  12. John Neff

    One big hit by a “drug dog” can offset many false positives. One of our local “drug dogs” found $100,000 in a secret compartment on a car and that convinced almost everyone that the dogs were reliable.

    I think a lot of the “probable cause” stuff is bluffing.

    If the cops were tipped off by an informant the dog may just be a prop.

    Lot of luck dealing with such a biased data set.

  13. SHG

    Among the many flaws of drug dogs, there is no reliable data about the number of real world searches where the dogs are used to create PC because the cops wanted to search beforehand, or the number of dog hits where nothing was found and the defendant went on his way. It’s rife with flawed statistics and potential for abuse. But those dogs are so cute, who wouldn’t trust them?

  14. Erika

    Me, I’m scared of dogs!

    I also seem to remember the local police bringing police dogs into my elementary school to talk about how the police dogs eat children who get arrested. Okay, I probably daydreamed that 😉

    But I would argue that there is a huge intimidation factor present when the the police bring out big dogs with ultra sharp teeth who want Erika Kabobs for dinner. Such intimidation of suspects would then increase their nervousness which the police would use as an excuse to search the suspect. One might suspect that the extra intimidation – and “cooperation” for searches received as a result – brought about by having those big scary police dogs would produce some of the “positive” results.

  15. John Neff

    Admiral Beaufort had a good idea when he introduced a wind force scale in 1805.

    Do we need a Beaufort scale for probable cause?

    For example [1, 2, 3, 4, 5] where anything below 3 is not probable cause and 4 and 5 are probable cause.

  16. John Neff

    That is what we have now. You have to have a scale that gives feedback from the prosecution and judges to the police.

    As has been noted there is little or no feedback now which means the police can get away with saying “I say what probable cause is.”

  17. John Beaty

    Right. We want a scale, the police and courts don’t. We can create all the scales we want, the police and courts won’t use them. Which is why we’re having this discussion: we need the SC to create the scale, not you and me and SHG.

Comments are closed.