Tim wrote: Here's what I wrote about it in the forthcoming Routledge Companion to Epistemology, for which I wrote the entry on "Evidence".
Extraordinary Claims and Extraordinary Evidence
Another common slogan, also popularized by Sagan, is that Extraordinary claims require extraordinary evidence. Much depends, of course, on what counts as extraordinary, both in a claim and in evidence. It cannot be simply that a claim is unprecedented. At a certain level of detail, almost any claim is unprecedented; but this does not necessarily mean that it requires evidence out of the ordinary to establish it. Consider this claim: “Aunt Matilda won a game of Scrabble Thursday night with a score of 438 while sipping a cup of mint tea.” Each successive modifying phrase renders the claim less likely to have occurred before; yet there is nothing particularly unbelievable about the claim, and the evidence of a single credible eyewitness might well persuade us that it is true.
The case is more difficult with respect to types of events that are deemed to be improbable or rare in principle, such as miracles. It is generally agreed in such discussions that such events cannot be common and that it requires more evidence to render them credible than is required in ordinary cases. (Sherlock 1769) David Hume famously advanced the maxim that No testimony is sufficient to establish a miracle, unless the testimony be of such a kind, that its falsehood would be more miraculous, than the fact, which it endeavours to establish (Beauchamp 2000, p. 87), which may have been the original inspiration for the slogan about extraordinary evidence. Hume appears to have thought that his maxim would place certain antecedently very improbable events beyond the reach of evidence. But as John Earman has argued (Earman 2000), an event that is antecedently extremely improbable, and in this sense extraordinary, may be rendered probable under the right evidential circumstances. The maxim is therefore less useful as a dialectical weapon than is often supposed. It may help to focus disagreements over extraordinary events, but it cannot resolve them.