Thoughts about scholarly journals, with an emphasis on mathematics, from a society publisher (now ex-publisher) -- meant to encourage thoughtful discussion about journals rather than strident posturing.
Monday, January 28, 2013
Who Pays in Author Pay?
Sunday, June 1, 2008
Citation Statistics
A report from the IMU in cooperation with ICIAM and IMS. On the use and misuse of citation data and statistics in assessing research.
Executive Summary
This is a report about the use and misuse of citation data in the assessment of scientific research. The idea that research assessment must be done using "simple and objective" methods is increasingly prevalent today. The "simple and objective" methods are broadly interpreted as bibliometrics, that is, citation data and the statistics derived from them. There is a belief that citation statistics are inherently more accurate because they substitute simple numbers for complex judgments, and hence overcome the possible subjectivity of peer review. But this belief is unfounded.
• Relying on statistics is not more accurate when the statistics are improperly used. Indeed, statistics can mislead when they are misapplied or misunderstood. Much of modern bibliometrics seems to rely on experience and intuition about the interpretation and validity of citation statistics.
• While numbers appear to be "objective", their objectivity can be illusory. The meaning of a citation can be even more subjective than peer review. Because this subjectivity is less obvious for citations, those who use citation data are less likely to understand their limitations.
• The sole reliance on citation data provides at best an incomplete and often shallow understanding of research—an understanding that is valid only when reinforced by other judgments. Numbers are not inherently superior to sound judgments.
Using citation data to assess research ultimately means using citation‐based statistics to rank things— journals, papers, people, programs, and disciplines. The statistical tools used to rank these things are often misunderstood and misused.
MORE
Saturday, November 10, 2007
What is the price of journal?
What’s the price of a journal?
For that matter, what is the price of a car or a novel or a loaf of bread? All these things are frequently discounted, but we don’t throw up our hands and claim that they don't have a "real” price. Yet on several occasions recently, I’ve heard people say that we can't tell the price of journals because they are often discounted.
When the editorial board of the journal Topology resigned and began a competing journal, Elsevier wrote: “Because the majority of our subscribers purchase this journal in a larger set of journals, most are paying a fraction of the institutional subscription price.” I’ve heard similar arguments from other publishers, who like to compute the “price” of a journal by dividing the total revenue by the number of “subscribers”. But that’s not the price! It’s the “average revenue per subscriber."
The (list) price of a journal is set by the publisher, and it’s plainly visible to anyone who examines annual price lists. For some journals, there may be a two-tiered price, one for institutions and one for individuals, but in every case there is a price. Just as for cars or novels or bread, journals may be sold at a discount. But it's important to remember that publishers discount journals for business reasons, not because, in a sudden fit of remorse, they want to lower the price. Journals are sometimes discounted to agents, who consolidate them to help libraries purchase from multiple publishers. They are discounted to institutional members of scholarly societies as a member benefit, in return for dues. And journals are discounted to subscribers who buy bundles of journals, often making a commitment to buy for several years. In each case, the publisher is discounting journals in order to gain some advantage -- it's a simple business arrangement.
There is nothing wrong with discounting journals; it's good business. But it doesn’t change the price. Indeed, the price is the starting point for all discounting arrangements, defining the terms of a bargain: I’ll return a portion of the price in return for some action on your part – consolidating, being a member, or purchasing a bundle. Confusing the discounted price with the actual price ignores one half of the bargain.
We should pay attention to the list price of a journal because inevitably some subscribers (quite often, most) pay the list price. But there are other reasons not to let publishers substitute the "average revenue per subscriber" for the price. The average revenue is a quotient, and publishers control both the numerator and the denominator.
Unlike the list price, we must rely on the publisher to tell us the numerator, that is, the total revenue for a journal. Calculating total revenue sounds straightforward until one realizes that when selling bundles, large publishers apportion revenue among many journals – a somewhat mysterious process that isn’t easily discovered. For many publishers, the total revenue assigned to a particular journal is a very fuzzy number indeed.
The denominator is even more problematic. How many subscribers does a journal have? If a publisher adds many journals to bundles at no charge, the number of subscribers will quickly rise. But adding unwanted (and frequently unused) journals to bundles doesn't really change the number of subscribers to each journal in any meaningful way. Allowing publishers to use these arrangements to calculate either the average price per journal (for an institution) or the average revenue per subscriber (for the publisher) is like allowing politicians to count all those people who might have voted for them (but didn't vote) in an election. And allowing publishers to tell us the "real" price of their journals is like asking car salesmen to dictate the "best" price for their cars.
Scholars face a crisis today caused by high journal prices. If they are going to make headway in addressing that crisis, they have to get smarter about journals and more sophisticated about business practices. They can't allow publishers to redefine the problem by redefining the price. That's neither smart nor sophisticated.
John Ewing
Thursday, November 1, 2007
Where are Journals Headed?
Where are Journals Headed?
Why we should worry about author-pay
Should we worry that all scholarly journals may follow a course dictated by one discipline's need for immediacy and availability of ample grant funds? Some open access proponents claim not. Everyone wins, they say, because not only do we gain universal access but, if the posting-fee is only the cost-of-posting, we will also save money -- lots of it. As for the lack of grants, institutional budgets will merely shift from subscriptions to “page-charges” (that is, author fees), so that even those without grant funds will be able to publish their research. It's simple, they say, a model that benefits all.
But there are good reasons to worry about this sanguine view of the new model for journals.
(i) In areas where most research is not grant supported, universities and colleges will have to pay author-fees by reallocating money from libraries (subscriptions) to other parts of the institution (departments? divisions?) that need the funds. But reallocating money is never a simple process. Will those who pay author fees from grants (biomedical sciences) be willing to give their library budgets to those who cannot (say, the humanities)? I suspect not. Will administrators look for ways to save money by shifting funds to other uses? Long experience suggests they will. Will departments with prestigious faculties demand more of the funds than those with less prestigious? Of course they will, and this will exaggerate differences throughout the university. Various constituencies will vie for funds, with inevitable winners and losers. Perhaps that's not bad, but it's surely not "simple".
(ii) The change in who makes decisions will change the market; this is basic economics. In the subscription model, users and librarians make decisions; in the author-pay model, authors and publishers make them. To succeed in the subscription model, a journal must secure enough subscriptions by convincing users and librarians that it has intellectual value. To succeed in the author-pay model, a journal must convince enough authors to submit papers and then it must accept enough of them to make money. Price will vie with prestige. The most prestigious journals will charge more and will attract authors who can pay the cost (grants will help). The less prestigious journals will discount their price in order to attract more authors and will increase the acceptance rate. Some institutions may demand that scholars use less expensive journals; others will demand that their faculty publish only in expensive ones. The result will be a distorted and ugly market, driven by some of the same forces that drive vanity publishing. This is what happens when a market is driven by producers instead of consumers.
(iii) The author-pay model emphasizes immediacy. All money exchanges hands before the article appears when the author pays a "posting-fee". After a short period of time, the material in the journal has no monetary value to the publisher, other than to attract more authors. This is a subtle but profound change from the subscription model. Because anyone can post articles on the web, unscrupulous publishers will take advantage of this short-term view by accepting marginal papers (or just plain junk) into newly created journals in order to make easy cash. Those who think scholars will not publish in such "instant journals" have not looked at current marginal publishers (who are kept in check only because they have to convince someone to buy their publications). Almost surely, more papers will be published in such a system.
(iv) The large commercial publishers will thrive in this new model. In fact, all large commercial publishers already have units devoted to open access publishing and are (quietly) pushing the author-pay model. Why? They will now produce a product for which they get paid by the supplier, in advance, without risk, and with lower overhead (because they don't have to sell subscriptions). And because the large publishers are diversified, they can take advantage of a changing environment. Small journal publishers in areas that have no grants to pay author fees will quickly go under; large publishers will expand into areas that are most lucrative. Large commercial publishers will end up with less competition in a market that is more easily manipulated -- a market they will dominate even more than now. Of course they are pushing the author-pay model!
The fundamental problem for journals is simple – we pay too much for them! It’s not access (which has never been better). It’s not our business model (which is shared responsibility). It’s not how we pay but rather how much we pay!
Many proponents of the author-pay model think we can solve this problem by switching to a new business model. Some have faith that publishers can be persuaded to set author fees only slightly higher than publication costs. But publishers who have profited from subscriptions in the past will certainly expect to profit from author fees in the future. (I can assure you that commercial publishers have this expectation.) Others believe they can run inexpensive author-pay journals themselves to compete with established journals, miraculously succeeding with upstart author-pay journals where upstart subscription-based journals have failed in the past. But there is no basis for this optimism. Indeed, since we will likely publish far more than ever before, we will likely spend far more as well. And here’s the largest worry about the author-pay model: It does not solve the fundamental problem of journals -- this model makes it worse!
We are therefore heading in the wrong direction. Scholarly journals are sick and they need attention. But instead of following a regimen of reasoned and disciplined remedies -- instead of driving down prices by the steady, concerted actions of authors, editors, and librarians -- we are bleeding the patient with open access models, trusting in miracles (that university administrators will shift funds from those with research funds to those without), and praying that publishers will repent their ways.
It is ironic that those leading us down this path of folk remedies and faith healing come from the biomedical sciences.
John Ewing
[1] These percentages are derived from data in the Genamics JournalSeek database. See http://journalseek.net/information.htm .
Wednesday, September 12, 2007
The Hysteria over PRISM
George Orwell would feel at home.
Saturday, July 1, 2006
Digital Downside
The Digital Downside
The Obsession with Open Access[1]
1 Careless Scholars
- A journal
posts an article in January; in April, without any notice, the editors
replace the article with a “corrected” version.
- A journal
posts an article in July; in November, the publisher simply removes the
article (without notifying the authors!).
- A journal
posts an article in April, but the author posts a corrected and
substantially changed version on a well-known server in October, with an
indication that the article appeared in April, but no indication that it
was different.
2 Big Deals
Big deals are now offered by Elsevier (an innovator in this area), Springer, Wiley, Blackwell, and Taylor & Francis. In a recent survey of US research libraries, 93% indicated that they held bundles with at least one of these publishers. Just about half (49%) held bundles with at least four. Wiley, Elsevier, and Springer have achieved 70% market penetration.[2]
3 Walt Disney
4 Mindless Accountants
5 Fads and Fashions
6 Summing Up
Thursday, June 1, 2006
Measuring Journals
By John Ewing
Not everything that can be counted counts, and not everything that counts can be counted.The impact factor was created in the late 1950s as a way to measure a journal's value by calculating the average number of citations per article over a specific period of time. Since citations generally reflect the interest of scholars in an article, the impact factor ought to reflect the average interest in articles appearing in a journal. This seems to be a sensible use of citations.
Albert Einstein (1879 - 1955), attributed
But the impact factor has far outgrown its original purpose. A recent article [4] on the impact factor asserts that "impact factors have assumed so much power ... that they are starting to control the scientific enterprise" and that they "play a crucial role in hiring, tenure decisions, and the awarding of grants." The same article quotes Eugene Garfield, the creator of the impact factor, who laments: "We never predicted that people would turn this into an evaluation tool for giving out grants and funding."
People misuse the impact factor because there are no explicit principles governing its interpretation. The impact factor is used to measure the value of things for which it was never intended (articles and authors, for example), and it is used to make faulty comparisons between unlike objects, including journals themselves.
This is not a new problem. For decades, scholars have complained about...... MORE
(Also published in the Notices.)
Sunday, August 1, 2004
The Orthodoxy of Open Access
Based on a debate that was held at the Society for Scholarly Publishing on Open Access. August 2004. Also found in Nature Forum.
Snow White was working around the cottage one day when she got word of a terrible cave-in at the mine of the seven dwarves. She frantically rushed to the mine, peered down the dust-filled shaft, and called out: ‘Hello there, are you all right?’
A distant voice came back: ‘I believe the politicians when they say we can solve our healthcare problems, fix Social Security, increase defense spending, pay down the debt, balance the budget, and still cut our taxes’. Snow White looked up.
‘Whew!’ she said… ‘at least Dopey is alive’.
We hear a lot about Open Access (OA) these days at publishing conferences, in scholarly magazines and even in the popular press. Advocates have tried to shape the debate as merely a call for experimentation, claiming they are only promoting a new business model: OA, they say, can be achieved by a simple shift of costs from subscribers to authors; OA is another model for paying the costs of publishing; OA is so obviously good for scholars that surely no-one can object.
The debate, however, is neither about experiments nor about business models. This debate is about single-minded beliefs—an orthodoxy that is promoted with religious fervour. A few quotes illustrate that fervour: MORE
Monday, March 1, 2004
Misdirection
About the debate on Open Access, which distracts us from the real crisis in journals -- exorbitant prices.Journals publishing is in crisis. For years, subscription prices have increased rapidly, often at annual double-digit rates. Prices for some journals have tripled in the past ten years, and the average increase is now close to ten percent. The budgets of university libraries have fallen far behind, forcing librarians to cancel subscriptions. Publishers have used declining subscriptions as a rationale to increase prices even more. And the literature has expanded, creating fatter journals (and yet more reasons for publishers to increase prices). Scholars and librarians have become increasingly unhappy about the state of affairs, and they demand action.
So what action do they suggest? They want to change the way in which publishers collect the money. Go figure. Instead of collecting money through subscriptions, they plan to charge authors a fee — perhaps $1,500 per article (although higher amounts are suggested). We are told that the real problem is access to information, and that we should focus our attention on making material more accessible. Magicians call this technique misdirection, and it's at the heart of all tricks. Are open access advocates really trying to trick everyone?
No—this misdirection is caused by a mistake.
MORE
Monday, December 1, 2003
A Modest Proposal: Copyright and Scholarly Journals
Modern copyright law seems to work for novels, music, and movies, but it doesn't work well for scholarly journals. Journals record the knowledge of one generation for the next—they are long-term affairs. Recently, scholars discovered that copyright was a major impediment to making the older literature available online because obtaining permission decades after a journal was published was often impossible. And scholars realize that these difficulties will increase as we migrate to new formats in the future. For scholarly journals, copyright protection is an obstacle, not a safeguard.
We cannot change the laws that protect novels, movies, and music for the sake of scholarly journals. Publishers have persuaded both themselves and lawmakers that our present copyright laws provide the right balance for these creative works, and we are unlikely to change their minds. We should look for practical solutions, not ideological jousts.
What's a practical solution? Be reactionary—revert to the older traditions of copyright, without changing the law. We should urge scholars when publishing journal articles to dedicate their work to the public domain after 28 years.1 Until then, authors and publishers control their work as at present (perhaps giving free access much earlier). After 28 years, the work belongs to the world, in keeping with the historical traditions of copyright.
MORE
Wednesday, October 1, 2003
Copyright and Authors
The argument is illustrated clearly in a recent article by Peter Givler, the Executive Director of the American Association of University Presses (Givler, 2003). The essay has the title "Copyright: It's for the Public Good." In his essay, Givler is condescending. ("The academics and librarians I know are smart, interesting, delightful people, but they do have some peculiar ideas about copyright.") He is a little smug. ("I think I understand academic values well enough, and the challenge of trying to make this scholarly publishing business serve those unbusinesslike ends has made my career interesting...") And he is sometimes misleading. ("Shakespeare, whose works are so well known, yet whose texts exist in so many versions, furnishes an instructive example of the perils of authorship before copyright."1 ) He ends his essay with a rousing declaration that paraphrases Supreme Court Justice Ruth Ginsburg to say copyright is "good law precisely because it is such a powerful force for public good."
Of course, some aspects of copyright are good, both for authors and for the public. Without copyright, publishing would fall into anarchy, as it has at certain times in the past. Large parts of our modern world—literature, movies, and music—depend on copyright. Even esoteric scholarly publishing depends on copyright (in spite of recent suggestions to the contrary by some ill-advised members of Congress who want to do away with copyright for all federally funded research). But copyright is not for authors, and copyright is not about fairness. Copyright is a complex system of laws and traditions, created to balance the rights and interests of three groups involved in publishing— authors, publishers, and public.
Not so, writes Peter Givler. He claims that copyright is simple and self-evident: ...MORE
(Also appeared in First Monday)
