{"id":1455,"date":"2025-02-25T11:40:37","date_gmt":"2025-02-25T11:40:37","guid":{"rendered":"https:\/\/socialscienceresearchfunding.co.uk\/?p=1455"},"modified":"2025-02-25T11:40:40","modified_gmt":"2025-02-25T11:40:40","slug":"a-peek-inside-a-research-funding-panel","status":"publish","type":"post","link":"https:\/\/socialscienceresearchfunding.co.uk\/?p=1455","title":{"rendered":"A peek inside a research funding panel"},"content":{"rendered":"\n

A version of this article first appeared in Funding Insight in November 2021 and is reproduced with kind permission of Research Professional. For more articles like this, visit <\/em>www.researchprofessional.com<\/em><\/a><\/p>\n\n\n\n

When it comes to research funding, I\u2019ve been poacher and gamekeeper. I\u2019m a research development manager, but I\u2019ve also served two terms as a public member of a research funding panel, and I still review the odd proposal. I\u2019m going to draw upon that experience to try to explain how funding panels tend to work. They obviously vary depending on funder and scheme. So treat this article as based on a true story, but with certain scenes invented for dramatic purposes.<\/p>\n\n\n\n\n\n\n\n

Once upon a time, in a hotel conference room\u2026<\/strong><\/h3>\n\n\n\n

I am one of about twenty-five other people sitting behind name plates and laptops round the outside of three sides of a horseshoe of tables. On the fourth side is a large screen.\u00a0 Most attendees are academic experts, drawn from a broad range of disciplines, to cover the full scheme remit. There\u2019s no such thing as a perfect panel, of course. Applications may still benefit or suffer through a lack of expertise, or through there being a panel member who is an expert in precisely the topic addressed by the application.<\/p>\n\n\n\n

There are a small number of non-academic reviewers. Also present are staff from the funder who will drive the PowerPoint, make sure the meeting runs smoothly, and remind panel members about the scheme rules, allowing the chair to focus on the business of the meeting. The chair has a very important role, and the panel chairs I\u2019ve worked with are more like facilitators who guide discussions and focus minds rather than impose their will. Nevertheless, the chairs I\u2019ve worked with have been very influential, but that\u2019s because they\u2019re nearly always right.<\/p>\n\n\n\n

We\u2019ll be here all day, having already spent several days preparing. Everyone serving on a funding panel takes their role and responsibility very seriously. It\u2019s a lot of work to read and engage with every bid. In four years of doing this, I\u2019ve never seen anyone under-prepared.<\/p>\n\n\n\n

Each panel member has been assigned a few applications to introduce to the panel. The lead introducer is usually the panel member whose expertise is closest to the proposal. Her role is to summarise the application in five minutes or less. If it\u2019s a full application, this will include comments at outline stage, the applicants\u2019 response, and expert peer reviewers\u2019 comments.<\/p>\n\n\n\n

Expert peer review comments are invaluable, and in practice we won\u2019t fund anything that none of the reviewers\u2019 support. However, most sets of reviews are mixed: the most frustrating was when we had one good, one bad, one mediocre. I\u2019d say that for around half of applications, reviewers\u2019 comments contain at least one comment that\u2019s based on an obvious misunderstanding. The introducer will mention it, and the panel will disregard it. Hostile or aggressive negative reviews are rare, and seldom influence panel members, who often disregard them entirely.<\/p>\n\n\n\n

After her summary, the lead introducer gives the panel her own opinion in terms of strengths and weaknesses and score. Then two other introducers\u2014including me or one of the other public representatives\u2014adds anything that\u2019s been missed or overlooked. We have a couple of minutes each and are told not to repeat previous points. I\u2019ll comment from a public perspective. We\u2019ll then add our scores, though all introducers can change their scores after the discussion.<\/p>\n\n\n\n

The introducers set the tone for the discussion. We don\u2019t have long to discuss each application\u2014perhaps twenty minutes total for a full proposal. Discussions are civil and disagreements polite. We all have the same goal\u2014to fund the best proposals\u2014and there is scope for legitimate disagreement.<\/p>\n\n\n\n

One phenomenon I have noted in the past was what I call a \u2018criticism cascade\u2019. Or, if you prefer, \u2018the Statler and Waldorf\u2019<\/a>. \u00a0Discussions start out positive, only for one critical comment to lead to another and another until the application\u2019s fate is sealed. If that first criticism hadn\u2019t been made, would the others be prompted? Or is it inevitable that someone will speak first, and then it all unravels? Are all potential criticism cascades always triggered, or do some get away with it?<\/p>\n\n\n\n

After discussion, we submit our scores individually and electronically, and they appear (anonymised) on the PowerPoint. We have a standard scoring system, but more importantly, the panel has a shared understanding of what a six, a seven, or an eight should be. New members get the hang of this quickly. Scores from peer-review panel members used the same scale, but without the calibration, were less useful. When this is done, we move onto the next proposal.<\/p>\n\n\n\n

At the end of the meeting, we\u2019re shown an overall ranking, and where the funding cut-off is. The chair asks if we\u2019re happy, especially if it is very close and\/or the ranking does not seem to be reflective of the discussions. This is important because our role is not to assign grades to applications, but to rank them in priority order. We\u2019re aware of the dangers of getting more critical as we go on, or being too positive or negative about the first application before we\u2019re properly calibrated. Or being grumpy with the last application before lunch, or lax with the first one after it. Sometimes we\u2019ll re-score.<\/p>\n\n\n\n

Some funding decisions are very marginal between applications that are very different and thus very hard to compare. There are more high-quality proposals than there is funding. Many excellent projects go unfunded and there\u2019s nothing panel members can do about it.<\/p>\n\n\n\n

With outline applications, we\u2019re only going to invite those that we think have a realistic chance of competing for funding \u2013 our chair\u2019s usual tie-breaker question is \u201cdo we want to see this again?\u201d<\/p>\n\n\n\n

The moral of the story<\/strong><\/h3>\n\n\n\n

What can we learn from this classic tale? Well, as with all great narratives, there\u2019s more than one takeaway. In this case, there are three main pointers for what you should do as an applicant. You should:<\/p>\n\n\n\n

Be confident that everyone is doing their best.<\/strong> I don\u2019t think anyone would deny that there are elements of luck involved at all stages, but luck is only a factor for high quality, competitive applications. If your proposal is flawed, vague, unclear, or offers only marginal benefit, no amount of luck will help.<\/p>\n\n\n\n

Make life as easy as possible for panel members, and particular for your introducers<\/strong>. It\u2019s very difficult for anyone\u2014no matter how intelligent and motivated\u2014to hold so much information about so many varied and complex proposals in their head at once. This means you must think very carefully about who you\u2019re writing for\u2014look to the sidebar for an article on that\u2014and craft your proposal accordingly. <\/p>\n\n\n\n

You should also make the significance of your proposal<\/a> clear, overt, and explicit \u2013 don\u2019t rely on reviewers to work it out. What\u2019s more, ensure that the summary, which everyone re-reads prior to your application being discussed, is as clear as can be and your proposal is structured so panel members can find key information quickly. Again, articles on those two crucial elements are in the sidebar.<\/p>\n\n\n\n

Apply or volunteer to serve on a funding panel.<\/strong> Whether for a major funder, or for seedcorn funding within your own institution. Often you don\u2019t have to be very senior\u2014balance on panels is really important. It\u2019s a vital service for your research community, you\u2019ll meet a lot of new and interesting people, and you\u2019ll see first hand how decisions are made.<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Understanding how funding panels usually work can help you write a more competitive application, says Adam Forristal Golberg.<\/p>\n","protected":false},"author":1,"featured_media":1457,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[16,8,6,19],"tags":[],"class_list":["post-1455","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-application-advice","category-career-young-researchers","category-funding","category-university-culture"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2025\/02\/0_uh6otvvyy7ljq5f4.jpg","jetpack_shortlink":"https:\/\/wp.me\/p1OLY1-nt","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/1455","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1455"}],"version-history":[{"count":6,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/1455\/revisions"}],"predecessor-version":[{"id":1463,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/1455\/revisions\/1463"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/media\/1457"}],"wp:attachment":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1455"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1455"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1455"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}