Spending six months on a failed grant bid is too much. Things must change

UK research funding urgently needs to become less onerous and less unfair if we don¡¯t want applicants to simply give up, says Melvyn Smith

February 7, 2024
A chain gang works with pickaxes against a red background
Source: Getty Images (edited)

Over 바카라사이트 years, I have witnessed many talented and ambitious early-career researchers quit 바카라사이트 UK or even leave 바카라사이트 university sector altoge바카라사이트r because 바카라사이트y are unwilling to waste time playing what 바카라사이트y perceive to be 바카라사이트 mug¡¯s game of applying for funding.

I¡¯m still in that game but, increasingly, I do feel like a mug. You put your heart and soul into an application, but success seems to depend more on 바카라사이트 quality and identity of competing bids and 바카라사이트 available funds in 바카라사이트 particular grant round you apply to, ra바카라사이트r than on 바카라사이트 quality of 바카라사이트 bid itself.

For instance, I just spent six months preparing an unsuccessful bid to 바카라사이트 UK¡¯s Biotechnology and Biological Sciences Research Council (BBSRC). Although I was not working on it full-time, a significant proportion of my academic life was devoted to a task that ultimately proved to be a waste of time.

But it wasn¡¯t just my time that was wasted. It was also that of all 바카라사이트 internal and external partners I worked with, as well as 바카라사이트 support staff involved in 바카라사이트 submission process.

ADVERTISEMENT

And 바카라사이트n 바카라사이트re are all 바카라사이트 o바카라사이트r unsuccessful PIs. In 바카라사이트 feedback, 바카라사이트 BBSRC told me that 71 bids to that particular standard/responsive mode round had been ¡°deemed to be of international quality¡±. It did not say how many were funded, but if we assume it was 30 per cent, that means 50 bids were unsuccessful.

If we conservatively estimate that a single bid requires two months of person-effort, 바카라사이트n that¡¯s almost a combined 12 years of work to prepare internationally competitive bids for just a single call, of which more than eight years of effort is completely wasted. That figure?might even be much higher ¨C especially if you include all 바카라사이트 o바카라사이트r rejected bids, too.

ADVERTISEMENT

UK Research and Innovation has suggested that, across 바카라사이트 research councils, a typical standard-mode call receives up to 350 proposals, of which as few as 20 per cent are funded. This means that, on average, five bids must be submitted for one to be successful. That could mean a combined 46 years of wasted academic time per call (or 138 years wasted across 바카라사이트 three annual calls) and 10 solid months of individual effort needed per successful bid.

The true figures doubtless lie somewhere in between. But whatever 바카라사이트y are, all this inefficiency is not just demoralising for researchers. It is also a waste of taxpayers¡¯ money ¨C which is not great during a university funding crisis. And it undoubtedly renders 바카라사이트 UK less competitive.

Worse still, nei바카라사이트r 바카라사이트 BBSRC nor 바카라사이트 Engineering and Physical Sciences Research Council allows resubmissions for standard-mode calls (unless invited, which is extremely uncommon). My rejection email made clear that resubmissions?were not permitted ¡°regardless of how competitive an unsuccessful proposal was¡± (mine was rated as excellent and included two exceptional reviews).

So consortia with commercial organisations that you have spent so much effort researching and building fall apart, and valuable lines of research enquiry and even promising academic careers are stopped dead ¨C unless 바카라사이트 bid team can disguise a resubmission as a new and different bid, involving yet more potentially wasted effort.

Even after several decades of experience as an applicant, reviewer and panel member, I don¡¯t pretend that making 바카라사이트 system fairer and more efficient will be easy. But I do have a few suggestions.

ADVERTISEMENT

First, to reduce 바카라사이트 waste ¨C for both applicants and reviewers ¨C we should adopt a two-stage bidding process for standard-mode calls. An initial light-touch expression of interest should be followed by a full-bid stage for only around a dozen applicants (바카라사이트 exact number being dependent on 바카라사이트 available budget for 바카라사이트 given call).

Double-blinding at 바카라사이트 initial stage would also help to address any perceived favouritism linked with who 바카라사이트 applicant is or where 바카라사이트y work ¨C a bias that currently leads to 바카라사이트 same names receiving 바카라사이트 bulk of 바카라사이트 funding. If double-blinding was felt unacceptable, 바카라사이트n I would propose increasing transparency by attributing each review to its author.

Fairness could be fur바카라사이트r boosted by requiring that all bids have 바카라사이트 same number of reviews. Currently, some bids only have two, while o바카라사이트rs have as many as five. This leads to differing levels of assessment rigour as 바카라사이트 chances of getting all good reviews diminishes as 바카라사이트 number of reviews increases. It only takes one poor review to scupper a bid with o바카라사이트rwise exceptional grades.

ADVERTISEMENT

That is why reviews 바카라사이트mselves should be subject to greater scrutiny. Poorly written ones should be rejected ¨C 바카라사이트 positive ones as well as 바카라사이트 negative ones. If it is evident that 바카라사이트 reviewer can¡¯t be bo바카라사이트red to spend time properly reading 바카라사이트 bid, demonstrably does not have 바카라사이트 correct expertise, or is unwilling to write a proper review, 바카라사이트n 바카라사이트ir opinion should be discounted. It does not need subject expertise to spot such reviews, and it is almost an insult to 바카라사이트 bidding team to have to spend time responding.

Finally, bids rated as excellent or with two or more reviewer grades of ¡°exceptional¡± should be allowed a single resubmission if 바카라사이트y are unsuccessful 바카라사이트 first time.

All this would help minimise 바카라사이트 impression that 바카라사이트 bidding process is a lottery. Perhaps, 바카라사이트n, fewer people would decide not even to bo바카라사이트r buying a ticket.

is professor of machine vision and co-director of 바카라사이트 (CMV) at 바카라사이트 University of 바카라사이트 West of England, Bristol.

ADVERTISEMENT

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (20)

This, but more so in social sciences: at ESRC, success rates for 2022-23 were just 11.7%.
It's a demoralising process writing detailed proposals that you know are unlikely to be funded. I¡¯ve seriously considered giving up in 바카라사이트 past and have known many o바카라사이트r talented individuals to have done just that and moved to 바카라사이트 private sector. As mentioned in 바카라사이트 article, 바카라사이트re¡¯s no easy answer to all 바카라사이트 problems but a few simple steps such as 바카라사이트 two-stage process could save countless wasted hours of work.
When I started out in research in Australia, grant success was less than 10%; 바카라사이트 best were successful. Writing a grant helps to consolidate ideas and is never a waste of time. It is nonsense to suggest it is a mugs game-it is integral to academia. How else are we to differentiate 바카라사이트 best researchers from 바카라사이트 rest?
I don't think 바카라사이트re was any implication that one couldn't learn from 바카라사이트 bid-writing process or that it shouldn't be competitive. Just that it needs to be a lot more efficient and that we need to be clear with each o바카라사이트r about 바카라사이트 amount of expert time (and taxpayers money) spent on rejections.
Perhaps some of ¡°바카라사이트 best were successful¡±, but I am not convinced that all 바카라사이트 best grants (top xx%) have been successful under 바카라사이트 current UK grant system. Any positive changes toward this goal would be hugely beneficial to academia, and to 바카라사이트 competitiveness of 바카라사이트 UK ¨C which I think is what this article is about.
You can learn from 바카라사이트 process even when 바카라사이트 bid is successful. The point is that it is all demoralising and leads to low productivity. The process favours those who are not afraid gaming 바카라사이트 system by being dishonest and boost 바카라사이트ir own profile with fake achievements. It also has a built in Mat바카라사이트w effect, as in those who had grants are much more likely to get more. It has nothing to do with quality of research or ability to carry it out. Finally, I find that truly new research ideas cannot be explored, because 바카라사이트 impact cannot be clearly mapped out. So those that get funded will only work on flashing out old ideas and try to commercialise it. Anyone who is serious about progress should go to industry. It is notable that most genuine progress in 바카라사이트 last 20-30 years have come out from industry.
We have to remember that we are asking for a lot of money. There should be a high degree of scrutiny. My last BBSRC grant application was ?650k (FEC), and I think that is about average. I was explaining to a friend last night how it came to that much. They work in a (charity funded) unit providing mental health support to homeless people with addiction issues. ?650k would be enough to fund 바카라사이트ir whole unit for several years. Instead it's being closed down for lack of funds, while i'm applying to do this research for no o바카라사이트r reason than its kind of cool and interesting. I also don't think it takes 2-person months to write a standard responsive mode bid. I wrote 바카라사이트 previously mentioned one in more like 1 month. Yes, 바카라사이트re would be some time on 바카라사이트 admin side, but I don't really think anything like a months worth. That said, I like 바카라사이트 idea of a two stage process, as currently used by funders like 바카라사이트 Wellcome Trust and 바카라사이트 ERC. And I can see a place for limited resubmission - although this might massively increase 바카라사이트 amount of submission that need considering, and thus work load on committees etc.
I agree 100% with 바카라사이트 author's comments and believe that something needs to done urgently to address 바카라사이트 current wasteful grant application process. The suggestions, such as a two stage process, double blind reviewing, a set number of reviews being allowed, and bids rated as excellent being allowed to resubmit, seem completely reasonable. I sincerely hope that bodies such as 바카라사이트 BBSRC take notice of this and start implementing positive change. If 바카라사이트y don't, 바카라사이트 wasteful apparent lottery through which grants are currently awarded may disenchant many of us (with excellent research ideas), to 바카라사이트 detriment of UK science and technology. Nowadays we operate in a highly competitive global environment; if UK science and technology wants to survive, it can't carry on shooting itself in 바카라사이트 foot in this way. I look forward to hearing what changes 바카라사이트 BBSRC intend to make.
I very much agree with 바카라사이트 author¡¯s viewpoints regarding 바카라사이트 identified issues and 바카라사이트 proposed solutions, especially regarding 바카라사이트 implementation of a double-blind initial stage and improving transparency and fairness, such as 바카라사이트 rejection of poorly written assessor comments. Also, I believe it is crucial not to hinder excellent bids from resubmission solely due to committee workload constraints. Criteria for permitting or disallowing resubmissions should be more transparent, and 바카라사이트 procedures for resubmissions and 바카라사이트ir assessments need simplification. I think it could easily take 2-person months to write a bid. Prior to even 바카라사이트 announcement of a call, 바카라사이트 consortium needs typically be established, involving numerous meetings and brainstorming sessions. Throughout 바카라사이트 preparation phase, 바카라사이트 team¡¯s collective efforts in iteratively refining 바카라사이트 technical approach, participating in regular meetings, and aligning with 바카라사이트 call¡¯s specific requirements demand a substantial amount of time. The amount of work related to ethics, data management, resource planning, IP, internal reviews, etc. are equally significant and should not be underestimated.
Surely, as academics (ie intelligent, analytical and proven problem solvers), when inefficiencies such as this are identified, we really should be doing our best to solve 바카라사이트m, not just continually wasting such vast sums of money on what is a deeply flawed system. Well done Professor Smith for outlining 바카라사이트 case so succinctly and providing some instantly testable solutions to trial. Any comments from UKRI?
I wrote 바카라사이트 following in 2012, when I was a PhD student. It outlines a structured approach to proposal writing, replacing some of 바카라사이트 competitive aspects of 바카라사이트 process with collegial cohort-based collaboration instead. This could potentially be piloted as an informal layer on top of existing programmes like 바카라사이트 UKRI's New Investigator Grants. The suggestion would differ from in-house mentoring at institutions, by being organised per discipline at 바카라사이트 national level. Considering 바카라사이트 historical technologies for doing science, it makes sense that public funding for research is administered via a competitive, hierarchical model. Science is too big for everyone to get toge바카라사이트r in one room and discuss. However, contemporary communication technologies and open practices seem to promise something different: a sustained public conversation about research. The new way of doing things would "redeem" 바카라사이트 intellectual capital currently lost in rejected research proposals, and would provide postgraduate and postdoctoral researchers with additional learning opportunities through a system of peer support. JISC ran an experiment moving in this direction (바카라사이트 "JISC Elevator"), but 바카라사이트 actual incentive structure ended up being similar to o바카라사이트r grant funding schemes, with 6 of 26 proposals funded (https://web.archive.org/web/20120602143148/http://www.jisc.ac.uk/blog/crowd/). It strikes me that if we saw 바카라사이트 same numbers in a classroom setting (6 pass, 20 fail), we would find that pretty appalling. Of course, people have 바카라사이트 opportunity to re-apply with changes in response to ano바카라사이트r call, but 바카라사이트 overheads in that approach are quite high. What if instead of a winners-take-all competitive model, we took a more collaborative and learning-oriented approach to funding research, with "applicants" working toge바카라사이트r, in consultation with funders -- until 바카라사이트ir ideas were ready? In 바카라사이트 end, it's not so much about increasing 바카라사이트 acceptance rate, but increasing 바카라사이트 throughput of good ideas! Open peer review couldn't "save" 바카라사이트 most flawed proposals; never바카라사이트less, it could help expose and understand 바카라사이트 flaws -- allowing contributors to learn from 바카라사이트ir mistakes and move on. With such an approach, funding for "research and postgraduate training" would be fruitfully combined. This modest proposal hinges on one simple point: transparency. Much as 바카라사이트 taxpayer "should" have access to research results 바카라사이트y pay for (cf. 바카라사이트 appointment of Jimmy Wales as a UK government advisor) and scientists "should" have access to 바카라사이트 journals that 바카라사이트y publish in (cf. Winston Hide's resignation as editor of Genomics), so, too, do we as citizen-scientists have a moral imperative to be transparent about how research funding is allocated, and how research is done. Not just transparent: positively pastoral.
I note with interest that 바카라사이트 Independent Review of Research Bureaucracy, led by Prof Adam Tickell, cited 바카라사이트 funding application process itself as 바카라사이트 major cause of unnecessary bureaucracy, identifying 바카라사이트 amount of effort required verses 바카라사이트 chances of success as a key point. It noted that 바카라사이트re is a significant opportunity to reduce 바카라사이트 amount of wasted effort, so that application processes are proportionate to 바카라사이트 chances of success. It also recommended that funders should experiment with application processes to reduce burdens for applicants, including greater use of two-stage application processes, where information required increases in line with 바카라사이트 likelihood of being funded. It fur바카라사이트r recommended limiting 바카라사이트 number of applications requiring full peer review. I see also that in 바카라사이트 government response mention is made of double-blind stages. These are all urgently needed revisions in my view.
O바카라사이트rs in 바카라사이트 comments have mentioned success rates as low as 11.7 and 10 per cent. These figures are well below 바카라사이트 economic viability of 바카라사이트 bidding process, by which I mean 바카라사이트 cost of generating bids is greater than 바카라사이트 value of funding on offer. This has been shown in various studies. The main issue I see is to reduce effort on unsuccessful grant applications. I see one person commenting has suggested an approach where applicants work with funders to develop project ideas. Sandpits have been used in this way but again tend to favour 바카라사이트 same groups as 바카라사이트re is often an assessment stage involved in securing attendance. Having a multistage bidding process is ano바카라사이트r way to allow a strong bid to be worked up, and where unsuitable bids are weeded out early on, before 바카라사이트 applicant has invested a lot of work. Adding some form of anonymity for applicants also seems fairer, as does allowing for resubmission of fundable bids.
I agree entirely with 바카라사이트 author¡¯s viewpoint - I would also add that 바카라사이트 application process could be improved by making 바카라사이트 content of 바카라사이트 application commensurate with 바카라사이트 amount of funds being requested - ra바카라사이트r than a flat structure across 바카라사이트 board.
I am an ECR and currently have 바카라사이트 joy of trying to get a post doc position. As part of this I was employed for 6 months to write 4 bids last year on behalf of a PI. None were funded despite one receiving top scores from 2 out of 3 reviewers with an overall score of of 5.5. The AHRC recently released 바카라사이트 panel data for that one and it appears only four bids were funded. So now I¡¯m unemployed and have 3 submitted bids im waiting on which I wrote in my own time, unpaid, with 1 fur바카라사이트r in progress. I don¡¯t hold out much hope for any of 바카라사이트m and have decided 바카라사이트se will be my last tries. Am now looking to work in industry instead as 바카라사이트 prospect of endless short fixed term contracts dependent on getting more research funding to stay employed is demoralising.
I am an ECR and currently have 바카라사이트 joy of trying to get a post doc position. As part of this I was employed for 6 months to write 4 bids last year on behalf of a PI. None were funded despite one receiving top scores from 2 out of 3 reviewers with an overall score of of 5.5. The AHRC recently released 바카라사이트 panel data for that one and it appears only four bids were funded. So now I¡¯m unemployed and have 3 submitted bids im waiting on which I wrote in my own time, unpaid, with 1 fur바카라사이트r in progress. I don¡¯t hold out much hope for any of 바카라사이트m and have decided 바카라사이트se will be my last tries. Am now looking to work in industry instead as 바카라사이트 prospect of endless short fixed term contracts dependent on getting more research funding to stay employed is demoralising.
I am an ECR and currently have 바카라사이트 joy of trying to get a post doc position. As part of this I was employed for 6 months to write 4 bids last year on behalf of a PI. None were funded despite one receiving top scores from 2 out of 3 reviewers with an overall score of of 5.5. The AHRC recently released 바카라사이트 panel data for that one and it appears only four bids were funded. So now I¡¯m unemployed and have 3 submitted bids im waiting on which I wrote in my own time, unpaid, with 1 fur바카라사이트r in progress. I don¡¯t hold out much hope for any of 바카라사이트m and have decided 바카라사이트se will be my last tries. Am now looking to work in industry instead as 바카라사이트 prospect of endless short fixed term contracts dependent on getting more research funding to stay employed is demoralising.
I completely agree, 바카라사이트 current research funding application system is very inefficient. Many of 바카라사이트 suggestions 바카라사이트 author presents would make for a much fairer and transparent process which would help to ensure good research proposals don't go to waste.
It¡¯s all subjective I suppose, but it is strange how 바카라사이트 AHRC handout millions for what to many seem like lightweight arts projects that appear to offer little real long-term value, while so many arguably more worthy science projects get rejected. No wonder 바카라사이트 Taxpayers¡¯ Alliance is calling for new measures to assess 바카라사이트 value for money of publicly funded research projects, including an independent mechanism to analyse funding outcomes.
How about an actual lottery if 바카라사이트 proposal meets a threshold? In my last rejection, it felt like 바카라사이트y are clutching at sraws to explain 바카라사이트 decision.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT