Bearcastle Blog » The Matthew Effect

The Matthew Effect

A little while back ("Let's Play Internet!") I wrote about trying to track down an authoritative attribution for this quotation:

The plural of "anecdote" is not "data".

It was fun but inconclusive, barely penetrating the surface of the murky waters of misattribution. It's a game I enjoy playing, although I only get to play in little installment (unless someone is willing to pay me to do it!).

At any rate, because of that piece, I now have a steady stream of visitors to my blog who google for the phrase and end up here, which is a nice thing, but it's made me think that I should push on and see whether we can penetrate to the next level in uncovering the correct attribution for the phrase.

A casual start with Google seemed to indicate two conflicting attributions, of which these were typical:

Glancing through the results, it looked like Brinner was leading Kotsonis about 3 to 1, so I asked the Google for these keywords and got the indicated number of hits:

Overall, more people appeared to attribute the phrase to Mr. Brinner, although more careful checking showed that not all of those 311 results were independent of each other.

But here's a surprise during that last search: Google asked (in it's irritating fashion): "Did you mean: anecdote plural brenner?" So, what if I did? Those keywords resulted in 266 hits. However, that path ("anecdote plural brenner") quickly seemed to degenerate. Many of the hits simply happened to have those three words without any reference to the phrase in question. It also turned up more attributions however, further muddying the waters:

The last one is interesting because we'll see the name "George Stigler" again; otherwise, this route didn't seem to be giving results that were going to converge on any useful information.

I thought maybe I should compare with what the MSN-search oracle might give. It served up about 250 results for "the plural of anecdote is not data" (as a phrase, i.e., with quotation marks in the search string — by comparison, Google turned up 4,900 hits for the phrase, but the first 100 didn't add much to what we'd already seen.1) Most just added their weight to the assertion that it was first uttered by Brinner, with a few supporting the Kotsonis assertion.

There were also some interesting outliers:

These are all evidently spurious, one-off attributions; it might be interesting to know how they came to be, but I don't want to get sidetracked.2 In addition to "some wag", I've seen "some sociologists", "a learned professor", and "anonymous" for attributions. I find these untidy and lazy.

One blog entry, written by yet another person (Sam, at liberaldestert) trying to track down the origins of the phrase, offered this very authoritative sounding bit of information:

Lee Bolin (Tempe, AZ) emailed his comments about the origin of the phrase I asked about in a prior posting (Blogger link may not work; it's the posting for 11/18) that "the plural of 'anecdote' isn't 'facts'":

"I believe that the original aphorism is "The plural of anecdote is data." The negation, that the plural is NOT data, seems to be a recent reaction by academics to the original phrase. I do recall that I read the original quote from Senator Moynihan in Time, Newsweek, or U.S. News over a decade ago, but I do not now know the specific citation. I also do not if it was Senator Moynihan's original thought, or if he had borrowed it from someone else.

A variety of other people, notably Ben Wattenberg, have used that phrase over the years. Senator Moynihan's own use of it appears from time to time in the Congressional Record. The negation, "The plural of anecdote is not data", seems to have arisen fairly recently and is popular with persnickety social scientists.

The date on this entry is Tuesday, November 26, 2002, important in the context of the next quoted piece. From the evidence I've been through today, I'm ready to disagree with e-mail author Lee Bolin's two assertions: that the original phrase did not have "not" in it (I think it did), and that the phrase has anything at all to do with Senator Moynihan (it appears to owe nothing to him) except that he may have repeated it on some occasion. I fear that these may be fabrications, albeit well-intentioned, on Mr. Bolin's part.

Going back to Google, then, and asking about "anecdote plural stigler" gave 161 results, not as many as Mr. Brinner had, but number of hits can be a dangerous metric. The results for Stigler seemed to have a good variety of sources, which is suggestive that they were independent indications, and with dates that went back at least as early as 1995:

Most fundamentally, economists are mostly unmoved by industrial policy claims because, as George Stigler has quipped, “the plural of anecdote isn’t data.”
[Richard Beason and David Weinstein, "The MITI Myth", The American Enterprise Online, July/August 1995.]

Note that the "not" was part of the "quip" at this early date.

That search also turned up this very provocative nugget:

From: Difficult library reference questions list
Sent: Sunday, June 13, 2004 2:08 PM
To: STUMPERS-L@LISTSERV.DOM.EDU
Subject: ? Quotation. "Plural of anecdote is data."

We have been asked who first said or wrote: "The plural of anecdote is (not) data." The quotation is found both with and without the "not." We have searched standard quotation books (Bartlett, Oxford, Penguin, etc.) Lots of examples on the Web, the earliest being one from the economist George Stigler in 1991, but nothing to indicate he originated the phrase. Also one site which attributes it to Daniel P. Moynihan, but with no evidence. Any assistance in pinning down, if possible,the origin of the phrase will be appreciated. Sincerely

Stan Shiebert
Librarian
Arts, Recreation & Literature Department
Seattle Public Library

Don't you just love librarians! (And isn't it nice to know that there is a mailing-list for reference-librarian "stumpers"!) I'll have to write dozens of additional posts about libraries and my love for them and how I generally think of librarians as gods and goddesses, but anyway….

One wonders whether this reference to "one site which attributes it to Daniel P. Moynihan" is the site we'd just visited above, with the e-mail from Mr. Bolin.

This looks like a good place to pause in tracing the origins of the phrase, since we have an authoritative, trustworthy voice taking us back to 1991 with George Stigler as the originator. But one further (later) example might be amusing:

To paraphrase Nobel Prize-winning economist George Stigler, data are the plural of anecdote.
[Nathan S. Balke andMine K. Yucel, "Evaluating the Eleventh District's Beige Book – Brief Article", Economic & Financial Review, Oct, 2000.]

This one brings out two important points:

The unanswered question that comes to mind is: why did they feel the need to paraphrase in the first place?
———-
1Although there were several entries that seemed to be undertaking a very serious, deconstructionist sort of analysis of the phrase, which strikes me as rather silly, since it was a witticism to start with, not a dissertation in poetic form.

2The most likely explanation from the snippets that I read was that the person writing had received a communication from another person who used the phrase without attribution, so the writer atributed it to the correspondant.

3In quite a different context, I came across a short piece by physicist N. David Mermin, "Could Feynman Have Said This?" (Physics Today 57, no. 5, 2004 — subscription may be required), in which he was trying to track down first-hand evidence that Richard Feynman had actually said something frequently attributed to him.

Anyway, Mermin described the "Matthew effect":

The Matthew effect was enunciated by the great sociologist of science, Robert Merton [R. K. Merton, Science 159, 56 (1968)]. Merton worked in those innocent days when sociologists were interested only in the behavior of scientists and not in the content of their science. (To be fair to contemporary sociologists of science, I should modify that last phrase to "and not in the manifestations of that behavior in the content of their science.") I first learned of the Matthew effect more than 20 years ago, on the occasion of my first and, perhaps until now, only, victimization at the hands of the New York Times.

I learned the name for what the Times had done to me when I received a very nice note from P. W. Anderson in which he expressed his regret that the newspaper had given him exclusive credit for a nomenclatural advance that was entirely due to me. "A depressingly typical example of the Matthew effect" was how he characterized the misattribution. (I reported the entire history of this contretemps in these pages back in those dark ages [April 1981, page 46] before there were Reference Frame columns.) When I wrote back asking him what the Matthew effect was, he referred me to Merton.

It was Merton who identified and named the tendency always to assign exclusive scientific credit to the most eminent among all the plausible candidates. At least I hope it was he, though I'm sure Merton, who invented many wonderful jokes himself, would have been delighted if the credit for it turned out to be misattributed to him. Merton named the effect after the Gospel According to Matthew, because there it is written,

For unto every one that hath shall be given, and he shall have abundance: but from him that hath not shall be taken away even that which he hath.
—Mattthew 25:29.

Posted on August 8, 2005 at 15.01 by jns · Permalink
In: All, Such Language!

10 Responses

Subscribe to comments via RSS

  1. Written by Joanthan Day
    on Monday, 28 November 2005 at 07.11
    Permalink

    I heard the late George Stigler say that "the plural of aphorism is data" in, I think, 1981. He was the speaker at a University of Chicago Convocation (=degree awarding, commencement) ceremony that I attended. He delivered the aphorism as though he had said it before.

    Oddly enough there is a Steven Stigler (relationship to George unknown) who is a professor of statistics at the University of Chicago. Here is a brief quote from his paper, "International Statistics at the Millennium: Progressing or Regressing?" which can be found at http://www.stat.fi/isi99/proceedings/arkisto/varasto/stig0965.pdf

    +++
    …if we look around us at this sea of millennial retrospectives, it is striking that, as far as I am aware, they are divorced from any semblance of the discipline of statistical thought. Numbers may be cited, but only ceremonially. The accounts lean on anecdote, and often these are in short supply. Even if we were to accept that "the plural of anecdote is data," the accounts are selective in a manner that cannot be defended on statistical principle, and thus they hardly constitute even a datum. All of this is to say that most, perhaps all millennial retrospections lack logical grounding in the mother science of statistics.
    +++

    Is this Steven, the son of George, criticising his late father? I don't know. The George Stigler quote appears elsewhere on the web. It's possible that George made the "plural of anecdote is data" comment in a number of places (lectures, speeches, etc.) but never wrote it down.

    Now, to pile one paradox on top of another, here is an extract from a prestigious teaching award that Steven Stigler received at the same university:

    +++
    Anecdotes are to the statistician as experiments are to the chemist, and [Steven] Stigler is the master of the well-crafted, aptly chosen anecdote. The preferred form is one that takes an unexpected, amusing, and therefore memorable twist at the end to demolish the accepted wisdom. When such a tale is delivered with the skill of a master storyteller, and with the relish of an academic showing that a plausible argument espoused by Professor X is utter nonsense, the result is memorable, entertaining, and educational. Students get the point and they frequently remember it.

    The famous law of eponymy, the law that states that no idea in science is ever named after its original discoverer, is rightly called Stigler’s Law. This is a law with which it is difficult to quarrel: to do so is to suggest that Stigler is perhaps the original discoverer, and that is, of course, patently false as the law itself predicts. Stephen Stigler evidently takes great delight in ironies of this sort and uses similar devices to great advantage in the classroom to explain the intricacies of statistical reasoning.
    +++

    Is there a 'law of eponymy' for aphorisms?

  2. Written by Jonathan Day
    on Tuesday, 29 November 2005 at 19.01
    Permalink

    Apparently Stigler is quoted in the following journal as saying that the plural of anecdote is data. Of course, who knows whether the Antitrust Law Journal checked the source of the quote…

    [9]. See Jonathan B. Baker & Timothy F. Bresnahan, Empirical Methods of Identifying and Measuring Market Power, 61 ANTITRUST L.J. 3, 6 (1992) (quoting George Stigler).

  3. Written by Jonathon
    on Thursday, 15 March 2007 at 11.26
    Permalink

    A bit late perhaps, but I thought you might be interested in this American Dialect Society-Listserv post, in which the editor of the Yale Dictionary of Quotations describes an e-mail exchange with Berkeley political science professor Ray Wolfinger, who coined (at least one iteration of) the phrase "the plural of 'anecdote' is 'data'"—in 1969 or 1970.

  4. Written by jns
    on Wednesday, 21 March 2007 at 15.37
    Permalink

    Thanks, Jonathon, for the excellent contribution, pushing the date back even further, albeit on the alternate form of the aphorism that I think I like better anyway. However, it is easy to see why it might morph from "is" to "isn't" depending on the goals of the speaker — since it sounds so deep and profound in either form.

  5. Written by The Lay Scientist
    on Tuesday, 4 March 2008 at 05.58
    Permalink

    Antidepressant Meta-Study: A Formerly-Depressed Scientist's Perspective

  6. Written by Karly
    on Tuesday, 7 October 2008 at 00.17
    Permalink

    I am Frank Kotsonis's daughter and i can verify that it is his quote. I've been hearing the story about that quote since I was little.

  7. Written by Peter Kaminski
    on Wednesday, 4 May 2011 at 15.26
    Permalink

    Here are some cites from various print sources.

    In the 1980 publication, "Issues in Health Care Regulation," edited by Richard S. Gordon:

    "… in the words of a leading political scientist, Raymond Wolfinger, the plural of anecdote is data…"

    In the 1982 book, "The United States Congress," by Dennis Hale:

    "As Raymond Wolfinger has wisely observed, 'The plural of anecdote is data.'"

    In the August 24, 1986 edition of the Chicago Sun-Times, in a column by Daniel Patrick Moynihan:

    "Data is said to be the plural of anecdote."

    The "not" version appears to arise after the "is" version with various people, probably some independently. Here are a few.

    In the 1983 publication, "Canadian public administration:
    discipline and profession," by Kenneth Kernaghan:

    "In that the plural of the word anecdote is not data…"

    Irwin Bernstein in 1988:

    "The plural of anecdote is not data."

    In a syndicated 1990 newspaper column (I'm reading the Wilmington, NC "Morning Star" of November 15), "Can medicine be cost-effective?," by Samuel O. Thier:

    "… the plural of anecdotes is not data."

  8. Written by When Religion Meets New Media (A Review) | tech.soul.culture
    on Friday, 3 February 2012 at 19.02
    Permalink

    […] popular press, or hold up extreme and unusual cases as if they were representative of the norm. As that witty but difficult to attribute aphorism goes "the plural of 'anecdote' is not […]

  9. […] There is some contention over who coined this.  See here for a discussion. Like this:LikeBe the first to like this […]

  10. […] Après tout, « le pluriel d'anecdote n'est pas données » [ref]. Plus important, nous avions essayé de prendre en compte plusieurs biais espèce-spécifiques, […]

Subscribe to comments via RSS

Leave a Reply

To thwart spam, comments by new people are held for moderation; give me a bit of time and your comment will show up.

I welcome comments -- even dissent -- but I will delete without notice irrelevant, rude, psychotic, or incomprehensible comments, particularly those that I deem homophobic, unless they are amusing. The same goes for commercial comments and trackbacks. Sorry, but it's my blog and my decisions are final.