Yet another interesting piece in the Guardian on academia: Nobel-prize winner (in medicine) Randy Schekman declares he will no longer submit papers to ‘luxury’ journals such as Nature, Science and Cell. His main argument: 

These journals aggressively curate their brands, in ways more conducive to selling subscriptions than to stimulating the most important research. Like fashion designers who create limited-edition handbags or suits, they know scarcity stokes demand, so they artificially restrict the number of papers they accept. The exclusive brands are then marketed with a gimmick called "impact factor" – a score for each journal, measuring the number of times its papers are cited by subsequent research. Better papers, the theory goes, are cited more often, so better journals boast higher scores. Yet it is a deeply flawed measure, pursuing which has become an end in itself – and is as damaging to science as the bonus culture is to banking. 

It is well known that papers with ‘sexy’ topics tend to get higher impact – numbers of citations – than papers with less sexy topics, largely independently of the quality of the research reported itself. So the claim is that these journals are publishing a lot of bad science simply because they prioritize articles likely to get a lot of citations over solid scientific work.

How does this diagnosis transfer over to philosophy? In philosophy, impact factor is not as important as in other disciplines, but we are just as (or even more) obsessed with ‘brands’ and luxury journals. Another proxy on the basis of which we judge quality is the so-called ‘pedigree’, i.e. the institutions a person has been or is affiliated with. But all these factors are to a great extent heuristics to offload the responsibility of actually reading people’s papers and focusing on the quality of the written work as such.

Of course, the top journals in philosophy (the ‘Healy Four’ in particular) are highly selective, and it is fair to say that in most if not all cases the papers published in them demonstrate very solid scholarship. But as I’ve argued in a different blog post, it is far from obvious that publishing in these top journals is a necessary or even sufficient condition for excellence in philosophy. And yet, as remarked by an anonymous commenter in my previous post (#16), most of us have internalized to such an extent philosophy’s obsession with the ‘brands’ of luxury journals that we can’t help being impressed when looking at a CV with lots of publications (that we haven’t read) in these journals – and less impressed with a CV with publications in, say, the top 20 journals rather than the top 4.

So I submit that Schekman’s diagnosis of ‘brand curating’ applies, mutatis mutandis, to the 'luxury journals' in philosophy. In philosophy, the issue is less the thirst for high citation rates, but rather a tendency to reinforce ‘stardom’ and pedigree, and to exclude different, unusual approaches. Because these journals publish very few articles per year (which they don’t have to, given the current predominance of online publishing), there is a pressure to go with ‘safe bets’. A healthier model, it seems to me, is the one adopted by Synthese, which publishes a lot more papers per year, and a wide range of papers both in terms of topics and in terms of approaches. (There are other problems with Synthese though, including the very high subscription rate.) 

Of course, it is easy for someone like Schekman to boycott luxury journals at this stage of his career; he’s made it, he no longer needs the support of luxury brands to establish himself as a researcher. So given the current sociology of the profession, it might be too much of a risk, especially for younger philosophers, to forsake trying to get publications in the Healy Four altogether. All I’m suggesting is that we should bear in mind that a lot of exciting, solid philosophy is being published elsewhere; rather than use the brand as proxy to judge the quality of someone’s work, we should simply just read the papers.

(Full disclosure: I never managed to get anything published in the Healy Four, and the few times I’ve submitted papers to some of them, I’ve had very bad experiences with the refereeing process — with the exception of Nous. But who knows, maybe I'll be luckier next time…)

Posted in , ,

19 responses to “Academic journals as ‘brands’”

  1. Ernest Sosa Avatar

    Two points, if I may.
    First, journals do have their own character, and may exclude papers that are judged not to fit well, perhaps because they are judged to be too technical, or too scholarly, or too applied, etc. OF COURSE, excellent journal philosophy does not overlap perfectly with our top journals. The noted “character” of each journal has its effect and, besides, human error happens!
    Second, the following may be of interest, especially the update with my note on the “Healy Four.”
    http://leiterreports.typepad.com/blog/2013/07/top-philosophy-journals-without-regard-to-area.html

    Like

  2. Ernest Sosa Avatar

    PS: In fact it should be evident, though too often overlooked, that the overlap is VERY FAR from perfect!

    Like

  3. Catarina Dutilh Novaes Avatar

    Your second comment sums it all up! And on this: do you have thoughts on the idea of not restricting the number of papers published in these journals? (In PPR and Nous, but also elsewhere.) The number restriction made sense at a time when there were material constraints like the amount of paper to be used, but makes much less sense now that the main vehicle for journal publications is the internet.

    Like

  4. Ernest Sosa Avatar

    I see no accessible future without restrictions. The question is how to restrict properly. Here the desired “character” of the journal impinges, as does (more importantly) the threshold or twilight of adequate quality. Yes, we could have a centralized SUPER-JOURNAL that published ALL “publishable” papers, but that is not obviously better than our present pluralistic system.

    Like

  5. Steven French Avatar
    Steven French

    Just a quick note in support of what Prof. Sosa says – at the BJPS it is not primarily material constraints but first, ‘fit’ with the journal (is the paper too historical/philosophical (!)/physicky, whatever … or just plain ‘bonkers’?!) and second, quality as indicated by referees, associate editors, our own reading … that determine acceptability. Getting the balance right between acting as a quality gatekeeper and accommodating new approaches is always tricky of course, but given the sheer quantity of material that appears on a regular basis (I love Synthese but sometimes I feel utterly daunted when I get the latest contents alert!) urging us to simply read the papers is just not practical (at least not in my case, given all the other demands on my work time).
    cheers,
    Steven

    Like

  6. Catarina Dutilh Novaes Avatar

    Just to be clear: of course it is impossible to read all the interesting philosophical work being produced, even in one’s own sub-area. My remark about ‘reading the papers’ concerns moments when one is supposed to evaluate the quality of the work of a specific individual (say, a job application or tenure case); I’m simply suggesting that, rather than going by the ‘brands’ of the journals the person has published in, it is worth making the effort of checking out the actual written work. I feel there is a widespread tendency to rely on ‘brands’ and pedigree when evaluating someone’s work, and this seems to me to be problematic.
    Just to give an example: Branden Fitelson is currently the graduate admission officer at Rutgers. He now deliberately follows the policy of reading the candidate’s writing sample rather than going only with where the candidate is coming from. The result is that Rutgers is now accepting grad students from undergraduate institutions that were not making into the top philosophy programs before. It’s a bet, but Branden thinks it’s a risk worth taking. Over a few years we’ll see whether it will have paid off or not, in terms of the quality of the Rutgers graduates (which is already very high!). (This is all coming from personal communication.)
    And unline you, I actually quite enjoy the massive ToCs of Synthese! I quickly go through them and usually spot many articles that seem worth reading.

    Like

  7. Catarina Dutilh Novaes Avatar

    I agree that some restrictions are necessary, obviously. But it seems to me that the top journals in philosophy could publish more volume: there is both demand for it and enough high-quality work around. I worry that what Schekman says in the quote above (“Like fashion designers who create limited-edition handbags or suits, they know scarcity stokes demand, so they artificially restrict the number of papers they accept.”) is also applicable to these journals (though JPhil publishes a lot of papers, if I’m not mistaken). As discussed in comments to my other post I linked to above, the rate of acceptance in philosophy’s top journals tends to be lower than that of Science or Nature themselves.

    Like

  8. Steven French Avatar
    Steven French

    Thanks Catarina and sorry that I misunderstood you! And I agree completely that when it comes to job applications, promotions etc. we should not go by ‘brand’ (fwiw I am always hugely impressed by the work put in by my colleagues on search committees in reading and providing comments on candidates’ papers). And Branden of course is a star in all sorts of respects!
    But still, I agree with Sosa: “I see no accessible future without restrictions. The question is how to restrict properly.” I want to read new, exciting, novel stuff -desperately so at those, increasingly frequent, times when I feel jaded with the field. But I also don’t want to wade through reams of poor quality material to find those bright nuggets – just as with music, I want quality filters that don’t exclude the new and different! (I know, remember the saying “I want, never gets” but one can always hope …)

    Like

  9. Professor Plum Avatar
    Professor Plum

    J.Phil. does not publish a lot of papers in a year. A rough count suggests something like 24-36 articles/year (some of these are replies to earlier pubs etc.). When complaining it is good to have the facts straight. When you don’t have the facts straight, it raises questions about the credibility of other claims made.

    Like

  10. Catarina Dutilh Novaes Avatar

    Why is it always anonymous commenters who make comments like this? Seriously, thanks for checking the data, but the irony is not welcome. I was very clear above that I wasn’t sure of the volume of publication at JPhil.

    Like

  11. Catarina Dutilh Novaes Avatar

    More generally, if people have relevant data to share on numbers of articles published in each of these top journals, acceptance rates etc, they are most welcome to share them here.

    Like

  12. Rob Gressis Avatar
    Rob Gressis

    See, this is why I always recommend one sit on one’s blog comments for at least a few months before one posts them. You have to fact-check them, shop them around to make sure you haven’t overlooked any obvious objections, make sure you include the appropriate citations, etc. Otherwise you may something wrong!

    Like

  13. Catarina Dutilh Novaes Avatar

    Yep, sounds about right!

    Like

  14. Sara L. Uckelman Avatar

    including the very high subscription rate.
    Can you clue me in on why having lots of subscribers is a bad thing for a journal?

    Like

  15. Jamie Dreier Avatar

    I think Catarina meant the high price of a subscription, not the circulation.

    Like

  16. Catarina Dutilh Novaes Avatar

    I mean, expensive subscription rates.

    Like

  17. Crimlaw Avatar
    Crimlaw

    I very much doubt that Rutgers previously had a policy of not reading the writing samples of applicants to philosophy graduate school and I also very much doubt that Rutgers formerly chose to offer admission to students based on “where the candidate is coming from”. Rutgers has admitted students from quite a wide variety of undergraduate institutions for the last 20+ years. Whatever was personally communicated from Branden about this, there has been either some miscommunication or some misinformation.

    Like

  18. Catarina Dutilh Novaes Avatar

    It’s very well possible that I misunderstood what Branden told me, or that I’m misreporting it here. However, I do recall that he said that, while before Rutgers was making offers to more or less the same pool of candidates as the other top departments, it is now offering positions to candidates that are not getting offers from these other top places. So it seems to be using a different procedure to select its candidates, and the point seemed to be that now the candidates’ writing samples have more weight than before, and possibly more weight than elsewhere relative to ‘pedigree’.
    But none of what I say here is to be held against Branden, it’s all my own (possibly incomplete) recollection of that particular conversation.

    Like

  19. Sara L. Uckelman Avatar

    Ahah! That makes a lot more sense. I never would’ve thought to parse the sentence that way.

    Like

Leave a comment