An embarrassing moment for the skeptical movement

IMG_8356Twentyone years ago physicist Alan Sokal perpetrated his famous hoax at the expense of the postmodernist journal Social Text. It was at the height of the so-called “science wars” of the ’90s, and Sokal, as a scientist fed up with a lot of extreme statements about the social construction of science, thought of scoring a rhetorical point by embarrassing the other side. He wrote a fake paper entitled “Transgressing the Boundaries: Towards a Transformative Hermeneutics of Quantum Gravity,” full of scientific-sounding nonsense and submitted to the editors of Social Text. They didn’t send it out for peer reviewed and published it as a welcome example of a scientist embracing the postmodernist cause.

Sokal then proceeded to unveil the hoax in the now defunct Lingua Franca, a magazine devoted to academic affairs, thus exposing the sloppy practiced of the editors of Social Text while at the same time embarrassing the postmodernist community.

Sokal, however, is no intellectual lightweight, and he wrote a sober assessment of the significance of his stunt, for instance stating:

“From the mere fact of publication of my parody I think that not much can be deduced. It doesn’t prove that the whole field of cultural studies, or cultural studies of science — much less sociology of science — is nonsense. Nor does it prove that the intellectual standards in these fields are generally lax. (This might be the case, but it would have to be established on other grounds.) It proves only that the editors of one rather marginal journal were derelict in their intellectual duty.”

Move forward to the present. Philosopher Peter Boghossian (not to be confused with NYU’s Paul Boghossian) and author James Lindsay (henceforth, B&L) attempted to replicate the Sokal hoax by trick-publishing a silly paper entitled “The Conceptual Penis as a Social Construct.” The victim, in this case, was the journal Cogent Social Sciences, which sent out the submission for review and accepted it in record time (one month). After which, B&L triumphantly exposed their stunt in Skeptic magazine.

But the similarities between the two episodes end there. Rather than showing Sokal’s restraint on the significance of the hoax, B&L went full blast. They see themselves as exposing a “deeply troubling” problem with the modern academy:

“The echo-chamber of morally driven fashionable nonsense coming out of the postmodernist social ‘sciences’ in general, and gender studies departments in particular … As we see it, gender studies in its current form needs to do some serious housecleaning.”

And (a large chunk of especially influential people in) the skeptic community joined the victory parade:

“We are proud to publish this exposé of a hoaxed article published in a peer-reviewed journal today.” (Michael Shermer)

“This is glorious. Well done!” (Sam Harris)

“Sokal-style satire on pretentious ‘gender studies.'” (Richard Dawkins)

“New academic hoax: a bogus paper on ‘the conceptual penis’ gets published in a ‘high-quality peer-reviewed’ journal.” (Steven Pinker)

“Cultural studies, including women’s studies, are particularly prone to the toxic combinations of jargon and ideology that makes for such horrible ‘scholarship.'” (Jerry Coyne)

Except that a mildly closer look shows that Boghossian and Lindsay are no Sokals, and that the hoax should actually be treated as an embarrassment for the skeptic community. Let’s do a bit of, ahem, deconstructing of the conceptual penis affair.

(i) Like the Sokal hoax, the sample size is n=1. Since Boghossian teaches critical thinking, he ought to know that pretty much nothing can be concluded from that sort of “sampling” of the relevant population. That’s why Sokal properly understood his hoax as a rhetorical success, a way to put the spotlight on the problem, not of showing anything broader than “that the editors of one rather marginal journal were derelict in their intellectual duty.”

(ii) The B&L paper was actually rejected by the first journal it was submitted to, NORMA: The International Journal for Masculinity Study. Boghossian and Lindsay admit this, but add that they were “invited” to resubmit to Cogent Social Sciences, which is handled by the same prestigious Taylor & Francis publishing group that handles NORMA. The reality is that NORMA itself doesn’t make it even on the list of top 115 publications in gender studies, which makes it an unranked journal, not a “top” one. also, if you check Cogent Social Sciences’ web site you will see that it operates independently of Taylor & Francis. Oh, fun fact: NORMA’s impact fact is a whopping zero… And remember, it actually rejected the paper.

(iii) The “invitation” to resubmit to Cogent Social Sciences was likely an automated email directing the authors to an obvious pay-to-publish vanity journal. See if you can spot the clues from the journal’s description of their acceptance policies. First, authors are invited to “pay what they can” in order to publish their papers; second, they say they are very “friendly” to prospective authors; lastly, they say that they do not “necessarily reject” papers with no impact. Does that sound to you like a respectable outlet, in any field?

(iv) But isn’t Cogent Social Sciences said to be “high quality” by the Directory of Open Access Journals (DOAJ)? It may be, but the DOAJ is community run, has no official standing, and to make it on its list of recommended publications a journal “must exercise peer-review with an editor and an editorial board or editorial review…. carried out by at least two editors.” Even vanity journals easily meet those criteria.

All of the above said, I am indeed weary of “studies” fields, of which women and gender studies are just a couple of examples. As I’ve written in the past, my experience actually interacting with some faculty and students in those programs has been that they do have a tendency to insularity, which could be remedied by integrating them into the appropriate classic departments, like philosophy, history, comparative literature, and the like. That, in fact, was the original intention when these programs first appeared decades ago, and my understanding is that it was the traditional departments that did not want to go down that route, in order to protect their turf, faculty lines, and students tuition money.

It is also the case that many in “X Studies” programs embrace left-leaning politics and see themselves as activists first, scholars next. This is a problem, as the two roles may lead to conflict, in which activism may prevail at the expense of sound scholarship. But the problem isn’t confined to X Studies, as it is found, for instance, in ecology (where a lot of practitioners are also involved with environmentalist organizations), cultural anthropology (protection, not just study, of indigenous populations), and frankly even critical thinking and philosophy. I have made a career of studying pseudoscience (academically) while at the same time advocating on behalf of science and reason (blogs, books, articles, podcasts). So the two activities shouldn’t be seen as ipso facto incompatible (as, for instance, social psychologist Jonathan Haidt does). But one does need to thread cautiously nonetheless.

Finally, my observation by talking to colleagues in X studies and reading some of their papers (an approach that Boghossian and Lindsay boast of having rejected, because they apparently know a priori that it’s all bullshit), is that there is a tendency to embrace a form of environmental determinism — as opposed to its genetic counterpart — about human cognitive and cultural traits. This attitude is not scientifically sound, and it even generates internal conflict, as in the case of some radical feminists who reject any talk of being “trapped in the wrong body” by transgender people. As someone who has actually studied gene-environment interactions I am extremely skeptical of any simplistic claim of either genetic or environmental determination. Human beings are exceedingly complex and inherently cultural organisms, and the best bet is to assume that pretty much everything we do is the highly intricate result of a continuous interplay among genes, developmental systems, and environments.

So yes, X Studies are potentially problematic, and they probably ought to undergo academic review as a concept, as well as be subjected to sustained, external scholarly criticism. But this is absolutely not what the B&L stunt has done. Not even close.

And of course, for balance, let’s remember that science too is subject to disturbingly similar problems (thanks to Ketan Joshi for this brief summary, to which many, many more entries could easily be added — here is a similarly good take):

* Andrew Wakefield, a British anti-vaccination campaigner, notoriously managed to publish a fraudulent paper in the (really) prestigious medical journal Lancet in 1998.

* A US nuclear physics conference accepted a paper written entirely in autocomplete.

* A trio of MIT graduate students created an algorithm that produces fake scientific papers, and in 2013 IEEE and Springer Publishing (really seriously academic publishers) found a whopping 120 published papers that had been generated by the program.

* A paper entitled “Get me off your fucking mailing list” was accepted for publication by a computer science journal.

* A 2013 hoax saw a scientific paper about anti-cancer properties in a chemical extracted from a fictional lichen published in several hundred journals.

And of course let’s not forget the current, very serious, replication crisis in both medical research and psychology. Or the fact that the pharmaceutical industry has created entire fake journals in order to publish studies “friendly” to their bottom line. And these are fields that — unlike gender studies — actually attract millions of dollars in funding and whose “research” affects people’s lives directly.

But I don’t see Boghossian, Lindsay, Shermer, Dawkins, Coyne, Pinker or Harris flooding their Twitter feeds with news of the intellectual bankruptcy of biology, physics, computer science, and medicine. Why not?

Well, here is one possibility:

“American liberalism has slipped into a kind of moral panic about racial gender and sexual identity that has distorted liberalism’s message” — Michael Shermer, 18 November 2016

“Gender Studies is primarily composed of radical ideologues who view indoctrination as their primary duty. These departments must be defunded” –Peter Boghossian, 25 April 2016

Turns out that a good number of “skeptics” are actually committed to the political cause of libertarianism. This is fine in and of itself, since we are all entitled to our political opinions. But it becomes a problem when it is used as a filter to inform your allegedly critical thinking. And it becomes particularly problematic when libertarian skeptics go on a rampage accusing others of ideological bias and calling for their defunding. Self-criticism before other-criticism, people — it’s the virtuous thing to do.

This latest episode does not, unfortunately, surprise me at all. It fits a pattern that has concerned me for years, as someone who has been very active within the movement and who still identifies with its core tenets. When Steven Pinker openly embraces scientism, turning an epistemic vice into a virtue; or when atheists think that their position amounts to anything more than a negative metaphysical stance — and think that being nasty about it is the way forward; or when atheism, skepticism and scientism are confused with each other for ideological purposes; then I get seriously worried about the future of a movement that has so much potential to help keep the light of reason alive in a society that desperately needs it.

The Boghossian and Lindsay hoax falls far short of the goal of demonstrating that gender studies is full of nonsense. But it does expose for all the world to see the problematic condition of the skeptic movement. Someone should try to wrestle it away from the ideologues currently running it, returning it to its core mission of critical analysis, including, and indeed beginning with, self-criticism. Call it Socratic Skepticism(TM).

_____

Update: Steven Pinker has admitted on Twitter that the hoax was a bad idea: “‘Gender studies’ is an academic field that deserves criticism, but The ‘Conceptual Penis’ hoax missed the mark.”

Advertisements


Categories: Atheism & Religion, Public Philosophy, Social & Political Philosophy

69 replies

  1. On the bona fides of the “Cogent” journal, wouldn’t a proper journal bother to check that the authors of the papers they publish or the institutions they work at actually exist?

    Or do I gave a hopelessly idealistic view of academic journals as a whole?

    The dodgy journals don’t bother to check. There was one fictional person who has been appointed editor of nearly one hundred of these journals.

    The fact that “Cogent” didn’t bother to check seems to suggest they are not legitimate.

    Like

  2. Hi garthdaisy

    “You’re not helping. They are.”

    What are they helping?

    Like

  3. But another aspect of this business that’s bothering me is an overarching strategy of the skeptic movement as a whole, that one is trying to change public opinion through insults & humiliation. I’m not saying something that polemics and other rhetorical methods don’t have their place in a public debate but it’s this self-satisfying attitude that I don’t find effective in convincing people or as a fruitful intellectual enterprise.

    Liked by 3 people

  4. Hey Massimo,

    As you know I’m a lot more sympathetic to the likes of Pinker and Harris and Dawkins than you are, so you might expect me to take Coel’s line, but on this I’m probably more aligned with you. Your article is a pretty good takedown of the hoax and I agree with most of the points you raise.

    That said, I think Coel makes some good points too (e.g. about open access journals etc), but all in all I think you’re right that the skeptics were wrong to gloat as they did. Harris was particularly grating in his introduction to his latest podcast, where he couldn’t resist the impulse to read excerpts from the ludicrous paper and guffaw smugly at how anyone could be taken in. It wasn’t pretty!

    However, I think it would have been better if you had yourself resisted the impulse to take one last parting swipe at Pinker after he admitted he was wrong. What makes you so sure he knows nothing about gender studies? You appear to agree with him that it needs criticism, so was it really necessary to speculate that he is speaking from ignorance? I mean, maybe he is and maybe he isn’t. You’re quoting a tweet. It’s not like he was going to back up his position with references.

    Liked by 1 person

  5. Socratic,

    I’m fine with the baby analogy, but what, exactly, do you think I’m throwing out that I shouldn’t? Not a challenging question, actual curiosity.

    Like

  6. DM,

    You are right, my additional comment on Pinker was uncalled for. I have deleted it.

    Like

  7. Massimo, we’d probably have to have a further degree of dialog to find out how close you are to Dan’s seeming blanket rejection of the whole field of critical gender studies. I do know that in race/cultural studies, re your post of about six weeks ago with the Canadian author, while I totally agreed with her on Native American studies in the hard sciences, I fairly largely but NOT totally agreed with her on such studies in the social sciences, and I think you were at where she was at.

    ==

    And on Pinker, maybe Goldstein wrote “Plato at the SJWplex”?

    Like

  8. Robin,

    … wouldn’t a proper journal bother to check that the authors of the papers they publish or the institutions they work at actually exist?

    Probably not, since the number of instances where these are fabricated are pretty tiny, so likely it would not be something they routinely check.

    Like

  9. Like Bunsen Burner in his earlier comment, I have to admit I too was a bit puzzled by the controversy. But, after rereading Massimo’s OP, along with the link to the discussion in Skeptic–which seems at times almost puerile in both tone and focus–I think I better understand Massimo’s reservations. I also did some further querying since I wanted to better understand Massimo’s point in saying “Turns out that a good number of ‘skeptics’ are actually committed to the political cause of libertarianism.” At this point, I can’t see that much has been accomplished by B&L other than a rather sophomoric prank that reduces to self-flattering trolling.

    Maybe others here have found some compelling article in support of B&L, but I haven’t. I did come across an article in Salon that I found persuasive. Of note there for me was this paragraph:

    “As the historian Angus Johnston put it on Twitter, ‘If skepticism means anything it means skepticism about the things you WANT to be true. It’s easy to be a skeptic about others’ views.’ The quick, almost reflexive reposting of this ‘hoax’ by people like Dave Rubin, Richard Dawkins, Sam Harris, Steven Pinker, Christina Hoff Sommers and Melissa Chen reveals a marked lack of critical thinking about what exactly this exercise in attempted bullying proves.”

    I think it captures much of what Massimo suggests in his OP. For those interested, here’s the link to the Salon article:

    http://tinyurl.com/kmhzjm9

    Liked by 5 people

  10. Thomas: Excellent article. Don’t know if you saw this from Amanda Marcotte at the bottom, but it’s priceless:

    “If you’re out to disprove maleness is the source of all evil, acting like a couple of dicks isn’t the way to do it.”

    And actually, I would say that the same is true for the New Atheism that is the more traditional turf of the Shermer/Boghossian crowd. The worst way I can imagine trying to promote atheism is by acting like a bunch of douches, which is precisely what the Harris’s and Dawkins’ of the world do. It’s why I can’t stand the movement, even though I’m an atheist myself. It’s why Robert Wright has been very critical of the movement — he did an entire debate with Harris, whose focus was the sheer dickishness of the New Atheists — and I suspect its much of the reason why Massimo soured on it too.

    Liked by 2 people

  11. Yes, Dan K, I did. In fact, one can click on her link to bleedingheartlibertarians.com for comments from someone named James Taylor. (I don’t imagine he’s the singer/songwriter, though. 🙂 )

    Like

  12. Dan, indeed on Gnus.

    As for the best source of skeptical analysis, he unfortunately died of his cancer last year, but Bob Carroll’s Skeptic’s Dictionary is still my go-to.

    Re Gnu Atheists, and Dan’s take, and mine, and Massimo’s, on them, Bob carefully pointed out in the past that “atheism” is NOT the same as “irreligion,” noting the tens of millions of Theravada Buddhists.

    http://www.skepdic.com/

    Like

  13. I view this hoax as merely a more extreme example of a poor scientific paper, albeit one that was meant as a joke. Just because an article is published even in a reputable journal doesn’t mean it must be accepted whole cloth as legitimate. Weak and occasionally even fraudulent articles manage to be published in reputable journals all the time. When I read an article in a journal on a topic of which I’m versed, I always read it critically and skeptically, and never assume the conclusions of the authors. To read critically is up to everyone who reads scientific papers, or else you are merely reciting scripture. So when such hoaxes are perpetrated, it is with good intent that they stir the minds of scholars not be so complacent.

    Liked by 1 person

  14. One might wonder whether a hoax-describing article which draws conclusions beyond its evidence to support an ideological position was itself a hoax to demonstrate weak review at Skeptic magazine.

    Liked by 2 people

  15. Jim,

    A meta-hoax? I love it! But I doubt it…

    Liked by 3 people

  16. Hi Coel,

    Seriously? Academic journals wouldn’t bother to check that the authors are who they say they are or that an unfamiliar organisation really exists?

    That is pretty sloppy.

    Like

  17. I note that B&L paid a whopping $625 to get that paper published in a pay-to-publish journal.

    At that price they are welcome to hoax me and submit a paper to the Ern Malley Review which we run at the Department of Gender Studies at the University of Woolloomooloo where I am an assistant professor.

    That would serve me right.

    Liked by 4 people

  18. Per Jim’s comment, then Shermer having Sarich and Miele on his masthead REALLY demonstrated ???? Hmmm.

    And, Massimo, per Groucho Marx, “I never meta-hoax I didn’t like”????

    Like

  19. And, careful, Massimo … Ophelia’s linked to you. You might want to duck to avoid the crossfire.

    Like

  20. which we run at the Department of Gender Studies at the University of Woolloomooloo…

    = = =

    This made me cough up Scotch through my nose.

    Liked by 1 person

  21. Lots of comments, but it seems that still no-one has produced good evidence that Cogent Social Sciences is not a proper (though low-ranking) journal that is attempting proper peer review. (Those pointing to “pay to publish” just show their lack of awareness of open-access trends, and no other substantive issues have been pointed to.)

    I wonder whether the people running the journal and those responsible for it at Taylor and Frances will be thinking: “All this publicity is great! Everyone will know to send their worthless papers here, and we’ll be raking in the money!”.

    No, more likely they’ll be thinking: “We screwed up badly. There we were trying to build a reputable brand under the “Cogent” name, moving into the new open-access business model, and now we’re ridiculed by just about everyone”.

    Robin,

    Seriously? Academic journals wouldn’t bother to check that the authors are who they say they are or that an unfamiliar organisation really exists?

    Yes, seriously. At least not unless they’re given reason to check. If an astrophysics journal receives a paper from unfamiliar set of Chinese authors from a university in China that they’d never heard of (there are lots), then no, most likely they would not check. Why would they? The acceptance of the paper is supposed to depend on the quality of the paper, not on who the authors are.

    Liked by 1 person

  22. Coel,

    I find it fascinating that you are hang up on this issue. It seems to me obvious that the journal is a vanity outlet. But even if it wasn’t, unlike Sociale Text — the target of the Sokal hoax — this is at best an unranked journal. And their paper was rejected by another unranked journal with an impact factor of zero. Is that not enough to show how ridiculous the whole exercise was?

    Liked by 1 person

  23. Other words besides “fascinating” come to my mind. And, if Coel treated evidence as presented here as “lack of evidence” in his own field, he’d still believe the luminiferous ether was a real thing.

    Like

  24. Robin, here’s my paper: “Why ‘Waltzing with Matilda’ encodes the secret cisheteronormative patriarchy of homophobic, bestiality-repressing Australian sheep ranchers.” Please remit $625.

    Liked by 1 person

  25. Hi Massimo,

    I find it fascinating that you are hang up on this issue.

    You’re the one who wrote a whole blog article on it!

    It seems to me obvious that the journal is a vanity outlet.

    So you say. But just declaring it “obvious” is not that convincing when others don’t see it.

    But even if it wasn’t, unlike Sociale Text — the target of the Sokal hoax — this is at best an unranked journal.

    Sure, agreed — see the very first thing I wrote on this thread.

    Socratic,

    And, if Coel treated evidence as presented here as “lack of evidence” in his …

    What evidence am I overlooking or treating wrongly? Please be specific.

    Like

  26. Coel,

    Please read what I write a bit more carefully, if you are going to respond. The issue you are hang up about (wether the journal in question is vanity or simply very low ranked) is not what I wrote “a whole post” about.

    Like

  27. Great article Massimo, I found the Libertarian swipe a-bit unjustified, but their tweets on the subject at hand very justified and shows a clear bias against the field and the fact that their conclusions were drawn before they even began.

    It made fore a nice debate on r/skeptic on reddit. I made a few mistakes I think but as a novice skeptic I did my best against someone who eventually revealed themselves to be homophobic and transphobic by the end.

    Miss you on Rationally Speaking!

    Like

  28. Thanks Justin, appreciated! On libertarianism, that’s mostly the result of my personal anthropological observations of the skeptic movement. There is a strong, if minoritarian, undercurrent of libertarianism, including certainly Shermer and Pen & Teller. Of course it is perfectly fine to hold that political view, but it becomes problematic if one goes after someone for their allegedly “obviously” biased political ideology…

    Like

Trackbacks

  1. Leading the thought - Butterflies and Wheels
%d bloggers like this: