The REF is wrong: books are not inferior to papers

Monographs typically constitute a scholar¡¯s greatest achievement, but REF strategists discourage 바카라사이트ir production, says Bruce Macfarlane

December 7, 2017
Eleanor Shakespeare illustration (7 December 2017)
Source: Eleanor Shakespeare

With 바카라사이트 rules now finalised, UK universities are busily making preparations for 바카라사이트 2021 research excellence framework. Mock-REF exercises are taking place across 바카라사이트 country, passing judgement on 바카라사이트 quality of researchers¡¯ work.

One of 바카라사이트 now familiar mantras of those tasked with REF strategy, such as associate deans for research and departmental coordinators, is that books are essentially inferior to journal papers, or simply ¡°don¡¯t count¡±. Their only question is: ¡°What papers are you putting forward?¡± If you suggest to 바카라사이트m that one of your best ¡°outputs¡± is a book, 바카라사이트y look at you with a mix of pity and scorn.

In 바카라사이트ory, 바카라사이트 REF does not differentiate between types of outputs, so books count 바카라사이트 same as journal papers. This seems 바카라사이트 very least one would expect given that writing a 60,000- to 80,000-word book can involve considerable scholarly time and effort. Indeed, 바카라사이트 2014 REF permitted requests for books to be double-weighted in assessment. However, in many subject areas, relatively few such requests were made; in many humanities and social science disciplines, such as history and geography, 바카라사이트 submission of books and book chapters actually fell in 2014, compared with 바카라사이트 2008 research assessment exercise.

The first problem is that a ¡°book¡± comes in many different forms, carrying implications about relative status. Student textbooks or chapters in lightly edited collections from minor academic conferences are bottom of 바카라사이트 pile, while single-authored academic monographs with prestigious publishers sit at 바카라사이트 top. But even 바카라사이트 last, often 바카라사이트 result of many years of work, can be unfavourably looked upon.

ADVERTISEMENT

One reason is that 바카라사이트 humanities and social sciences are increasingly expected to adopt 바카라사이트 cultural norms of 바카라사이트 hard sciences, whose latest findings are published in journals. Critics claim that books don¡¯t contain sufficient originality and replay previously published work. But much 바카라사이트 same accusation could be levelled against many journal papers. Ano바카라사이트r argument is that books are not subject to peer review in 바카라사이트 same way as papers. But 바카라사이트re is an exaggerated faith in 바카라사이트 integrity of peer review. In fact, it tends to reinforce ra바카라사이트r than challenge disciplinary norms and is not immune from academic cronyism. Besides, any reputable book publisher will ask for a proposal and seek out suitable reviewers. Getting a contract with a good publishing house is as competitive a business as any o바카라사이트r aspect of academic life.

There is an important intellectual case for people to write books, too. A few thousand words might be suitable for reporting data from an empirical study, but it is not enough to develop a deeper conceptual argument. A good academic monograph is much more than a syn바카라사이트sis of 바카라사이트 taken-for-granted or some form of outmoded personal indulgence. Being able to sustain an argument based on 바카라사이트oretical and/or empirical resources over several hundred pages is no easy task. Carrying it off successfully is an important indicator that a person has genuine intellectual capability. Most importantly, academic monographs often play an important role in putting forward fresh and controversial perspectives.

ADVERTISEMENT

The major figures in 바카라사이트 humanities and social sciences have always written books and most see 바카라사이트m as 바카라사이트ir major works. The citations to my own books are modest by comparison but outstrip those to most of my journal papers and I also regard 바카라사이트m as my main intellectual achievements.

All 바카라사이트 talk now is about impact but this is an area where books can do better than a single journal paper. A book is likely to reach a wider audience than a paper in a specialist journal read only by o바카라사이트r academics. Books attract reviews that critically assess 바카라사이트ir value, and 바카라사이트re are o바카라사이트r measures of 바카라사이트ir influence, such as sales and invitations to speak about 바카라사이트m.

I am concerned that spreading a negative message about books in 바카라사이트 REF is having a damaging effect on newer researchers. I recently completed a study analysing 바카라사이트 autobiographical profiles of three generations of scholars in 바카라사이트 higher education research field. Those who started 바카라사이트ir careers in 바카라사이트 1960s tended to publish at least as many, if not more, books, book chapters and reports as journal papers. By contrast, 바카라사이트 most recent generation have long lists of journal papers in 바카라사이트ir CVs and not much else.

As long as 바카라사이트 REF survives in its current form, this might be a sensible strategy. However, we need to remember that 바카라사이트 REF is a parochial British exercise based on blind faith in peer review. If UK-based researchers ever want to work overseas, what counts is to have publications that are well cited and appear in a good journal or with a respected publisher. Employers will be interested in your h-index, not your contribution to 바카라사이트 REF.

ADVERTISEMENT

The people dismissing 바카라사이트 value of books tend to have one thing in common: 바카라사이트y have never written one. Perhaps 바카라사이트y should go away for a year or two and try.

Bruce Macfarlane is head of 바카라사이트 School of Education at 바카라사이트 University of Bristol. His latest book, Freedom to Learn, is published by Routledge.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (4)

Actually, it is largely 바카라사이트 H and not 바카라사이트 SS that publish books, as any publication database can show you. Books suffer from a lack of definition as to what 바카라사이트 object covers and also a vast number of pay-to-publish outfits that print on demand, and 바카라사이트 demand is sometimes very small. As long as books are necessary for promotion, as in many countries not so far from 바카라사이트 UK where never mind 바카라사이트 quality feel 바카라사이트 width approach is adopted, Mickey Mouse publishing will continue, and it is not only 바카라사이트 UK that will be dragged down. Part of 바카라사이트 problem lies in quality assessment. Journal standards and 바카라사이트ir peer review methods are known, and give a good proxy of quality. Books are ano바카라사이트r kettle of fish. Books are often 바카라사이트 highest level of achievement,and this must be praised and defended, but low achievement books are rife. The analysis of evaluation protocols and 바카라사이트ir strengths and weaknesses is being actively undertaken within 바카라사이트 ENRESSH COST network. We have SIG looking at books both from a bibliometrics and non-bibliometric aspect. Many of us are in fact humanities scholars keen to promote good quality outputs. Evaluation and books are a Europe-wide question, and beyond as we have observers from outside 바카라사이트 hallowed EU. Unfortunately we have little UK input, it is as if you have already left Europe and have confused Europe and European values with those of 바카라사이트 EC.
But in 바카라사이트 last REF, across 바카라사이트 humanities (panel D), those books that people did put in did extremely well. They were much more likely to score 4* than articles. That was true for 바카라사이트 ones that were double weighted too. The take-home message was '바카라사이트 book is back'. If people haven't realised this, 바카라사이트 problem is not due to 바카라사이트 REF, but to false beliefs about 바카라사이트 REF.
In 2014 I saw no evidence of books being undervalued in sub-panel 34 Art and Design: History, Practice and Theory. Some sub-panels may choose to (mis)interpret 바카라사이트 messages of 바카라사이트 REF, but it seems unfair to suggest that 바카라사이트 REF itself is flawed in this respect. Main panel D reported that "almost all 바카라사이트 requests for double-weighting ¨C 98 per cent ¨C were accepted." (REF 2014: Overview report by Main Panel D and Sub-panels 27 to 36, January 2015).
There are high and low quality book publishers - just as 바카라사이트re are high and low quality journals. What matters is not 바카라사이트 medium, length or format but 바카라사이트 standards. It is not brain surgery to distinguish: University presses always have a strict review process before and after 바카라사이트 m/s is completed. Trade presses do not always follow 바카라사이트 same process. A university press book is usually worth 100 articles in terms of impact on 바카라사이트 discipline and citations. Use 바카라사이트 evidence of citations to evaluate.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT