The build-up to Christmas tends to be a funny time at universities. Well, I say ‘build up’, but it’s more of a ‘fade out’ as people slope off a few at a time on annual leave. We do very well in leave terms over Christmas because of ‘university holidays’, and I’m grateful for that. I get quite annoyed by the way that the sales and other commercial stuff seems to start up again straight away. Can’t we all have a bit of a break over Christmas?
Apropos of very little, and without even the flimsiest of justifications, here’s my favourite Christmas song… ‘It’s Clichéd to be Cynical at Christmas’ by the incomparable ‘Half Man Half Biscuit’.
Best wishes to you and yours for the festive season…..
It’s irritating enough doing this for myself, but it’s even more annoying when trying to cost a research project involving a lot of train trips. The project could be fairly cheap, or it could be massively expensive, depending upon brute luck, how organised academic colleagues are in requesting tickets, how soon the administrators can book them through the special magical portal of trail travel that universities seem to have, what time academics have to leave/arrive, and whether Mars is in the ascendant. Do we go optimistic, take an intermediate position, or take a wildly pessimistic one? Travel costs could end up being negligible in relation to the project as a whole, or run to a significant share of expenses. We could end up returning a fairly substantial slice of cash, or we could run out of money and/or cut the project activities short.
Guess what, rail companies? The rest of the budget is predictable. So why are you making life difficult? You don’t get research associates charging extra for work before 9:30, or offering to work for substantially less if you tell them what to do six weeks in advance. Transcription costs aren’t more expensive if the tapes leave London via Waterloo rather than St Pancreas International. Overheads aren’t more expensive in peak hours.
All this is bad enough. And then one train company – I’m looking at you, East Midlands Trains – makes it worse by plastering adverts featuring Jedward all over every phone box in the Greater Nottingham area. Damn you all. Damn you all to hell. On an apex network first advance single.
The Times Higher has a report on Sir Paul Nurse‘s ‘Anniversary Day’ address to the Royal Society. Although the Royal Society is a learned society in the natural rather than the social sciences, he makes an interesting distinction that seems to have – more or less unchallenged – become a piece of received wisdom across many if not all fields of research.
Here’s part of what Sir Paul had to say (my underline added)
Given this emphasis on the primacy of the individuals carrying out the research, decisions should be guided by the effectiveness of the researchers making the research proposal. The most useful criterion for effectiveness is immediate past progress. Those that have recently carried out high quality research are most likely to continue to do so. In coming to research funding decisions the objective is not to simply support those that write good quality grant proposals but those that will actually carry out good quality research. So more attention should be given to actual performance rather than planned activity. Obviously such an emphasis needs to be tempered for those who have only a limited recent past record, such as early career researchers or those with a break in their careers. In these cases making more use of face-to-face interviews can be very helpful in determining the quality of the researcher making the application.
I guess my first reaction to this is to wonder whether interviews are the best way of deciding research funding for early career researchers. Apart from the cost, inconvenience and potential equal opportunities issues of holding interviews, I wonder if they’re even a particularly good way of making decisions. When it comes to job interviews, I’ve seen many cases where interview performance seems to take undue priority over CV and experience. And if the argument is that sometimes the best researchers aren’t the best communicators (which is fair), it’s not clear to me how an interview will help.
My second reaction is to wonder about the right balance between funding excellent research and funding excellent researchers. And I think this is really the point that Sir Paul is making. But that’s a subject for another entry, another time. Coming soon!
My third reaction – and what this entry is about – is the increasingly common assumption that there is one tribe of researchers who can write outstanding applications, and another which actually does outstanding research. One really good expression of this can be found in a cartoon at the ever-excellent Research Counselling. Okay, so it’s only a cartoon, but it wouldn’t have made it there unless it was tapping into some deeper cultural assumptions. This article from the Times Higher back at the start of November speaks of ‘Dr Plods’ – for whom getting funding is an aim in itself – and ‘Dr Sparks’ – the ones who deserve it – and there seems to be little challenge from readers in the comments section below.
But does this assumption have any basis in fact? Are those who get funded mere journeymen and women researchers, mere average intellects, whose sole mark of distinction is their ability to toady effectively to remote and out-of-touch funding bodies? To spot the research priority flavour-of-the-month from the latest Delivery Plan, and cynically twist their research plans to match it? It’s a comforting thought for the increasingly large number of people who don’t get funding for their project. We’d all like to be the brilliant-but-eccentric-misunderstood-radical-unappreciated genius, who doesn’t play by the rules, cuts a few corners but gets the job done, and to hell with the pencil pushers at the DA’s office in city hall in RCUK’s offices in downtown Swindon. A weird kind of cross between Albert Einstein and Jimmy McNulty from ‘The Wire’.
While I don’t think anyone is seriously claiming that the Sparks-and-Plods picture should be taken literally, I’m not even sure how much truth there is in it as a parable or generalisation. For one thing, I don’t see how anyone could realistically Plod their way very far from priority to priority as they change and still have a convincing track record for all of them. I’m sure that a lot of deserving proposals don’t get funded, but I doubt very much that many undeserving proposals do get the green light. The brute fact is that there are more good ideas than there is money to spend on funding them, and the chances of that changing in the near future are pretty much zero. I think that’s one part of what’s powering this belief – if good stuff isn’t being funded, that must be because mediocre stuff is being funded. Right? Er, well…. probably not. I think the reality is that it’s the Sparks who get funded, but it’s those Sparks who are better able to communicate their ideas and make a convincing case for fit with funders’ or scheme priorities. Plods, and their ‘incremental’ research (a term that damns with faint praise in some ESRC referee’s reports that I’ve seen) shouldn’t even be applying to the ESRC – or at least not to the standard Research Grants scheme.
A share of this Sparks/Plods view is probably caused by the impact agenda. If impact is hard for the social sciences, it’s at least ten times as hard for basic research in many of the natural sciences. I can understand why people don’t like the impact agenda, and I can understand why people are hostile. However, I’ve always understood the impact agenda as far as research funding applications are concerned is that if a project has the potential for impact, it ought to, and there ought to be a good, solid, thought through, realistic, and defensible plan for bringing it about. If there genuinely is no impact, argue the case in the impact statement. Consider this, from the RCUK impact FAQ.
How do Pathways to Impact affect funding decisions within the peer review process?
The primary criterion within the peer review process for all Research Councils is excellent research. This has always been the case and remains unchanged. As such, problematic research with an excellent Pathways to Impact will not be funded. There are a number of other criteria that are assessed within research proposals, and Pathways to Impact is now one of those (along with e.g. management of the research and academic beneficiaries).
Of course, how this plays out in practice is another matter, but every indication I’ve had from the ESRC is that this is taken very seriously. Research excellence comes first. Impact (and other factors) second. These may end up being used in tie-breakers, but if it’s not excellent, it won’t get funded. Things may be different at the other Research Councils that I know less about, especially the EPSRC which is repositioning itself as a sponsor of research, and is busy dividing and subdividing and prioritising research areas for expansion or contraction in funding terms.
It’s worth recalling that it’s academics who make decisions on funding. It’s not Suits in Swindon. It’s academics. Your peers. I’d be willing to take seriously arguments that the form of peer review that we have can lead to conservatism and caution in funding decisions. But I find it much harder to accept the argument that senior academics – researchers and achievers in their own right – are funding projects of mediocre quality but good impact stories ahead of genuinely innovative, ground-breaking research which could drive the relevant discipline forward.
But I guess my message to anyone reading this who considers herself to be more of a ‘Doctor Spark’ who is losing out to ‘Doctor Plod’ is to point out that it’s easier for Sparky to do what Ploddy does well than vice versa. Ploddy will never match your genius, but you can get the help of academic colleagues and your friendly neighbourhood research officer – some of whom are uber-Plods, which in at least some cases is a large part of the reason why they’re doing their job rather than yours.
Want funding? Maximise your chances of getting it. Want to win? Learn the rules of the game and play it better. Might your impact plan be holding you back? Take advantage of any support that your institution offers you – and if it does, be aware of the advantage that this gives you. Might your problem be the art of grant writing? Communicating your ideas to a non-specialised audience? To reviewers and panel members from a cognate discipline? To a referee not from your precise area? Take advice. Get others to read it. Take their impressions and even their misunderstandings seriously.
Or you could write an application with little consideration for impact, with little concern for clarity of expression or the likely audience, and then if you’re unsuccessful, you can console yourself with the thought that it’s the system, not you, that’s at fault.
I hate having to take strike action. I hate having to take action short of a strike, which recently involved the highly radical step of, er, working to contract.
I particularly hate it at the moment because tomorrow will be my second anniversary at Nottingham University Business School. I think I’m very lucky to be at a well-run university and in a well-run School. I admire and respect my colleagues, and have no reason to think that that respect isn’t returned. I enjoy my work – challenging enough to stretch me, not so stressful that it might break me. I hope these words won’t come back to haunt me, but for now, I consider myself to be very, very lucky.
So I don’t want to strike. I also don’t want to ‘politicise’ my blog by saying too much about it. Not least because it’s hard to get to the bottom of what’s really going on. I’ve foolishly neglected to become an expert in pensions, and so I don’t fully grasp the issues. I know enough not to take at face value the information that the employers are giving us, nor the information from the UCU. On the one hand, it’s hard not to conclude that (regardless of your personal politics) that the government is doing all kinds of things that it’s secretly wanted to do for ages under the guise of TINA (‘There Is No Alternative’). It’s also hard to avoid the fact that changes were made to our pension scheme not so long ago that were supposed to address the (undoubted) issues of longer life expectancy. So it’s hard not to wonder why we’re back again so soon. And hard not to wonder how long it will be before we’re back revisiting and adjusting again. And again. And again.
There’s something of the theatrical about all of the public posturing and negotiations and the wars of words and the spin that goes on with every industrial dispute. Often I think what’s really going on is not what it seems. “Offers” are made which are intended to be rejected, and in the full knowledge that a better offer will be made after the inevitable industrial action. Unions ask for more than they could possibly expect to get. In the end, we usually end up with an agreement which lets both sides claim victory and appease their constituency. But what we will have tomorrow is a show of the strength of feeling and stomach for a fight. It may or not make any difference in the short term. But in the long term, it sends a clear signal and it will make a difference to the eventual outcome of the war, even if the ‘battle’ is stage managed.
I’d recommend union membership to anyone. If you can join a union, you should. Not only will they represent members’ interests collectively, they’ll also have your back if things go bad and make sure you get due process and fair treatment. If I had a pound for every story I’ve heard about union representation and support making a real difference to how someone is treated, I’d make at least some of the cash back that I’ll lose by striking tomorrow.
Prompted in part by an interesting discussion of the importance of the budget in establishing the overall credibility and shape of a research proposal at the ever-excellent Research Whisperer, I thought I’d put fingers-to-keyboard on the vexed issue of estimating staff time on research grant applications. Partly this is to share some of what I do and what I recommend, but mostly it’s to ask others how they approach it. Comments, thoughts, suggestions, and experiences welcome as ever in the comments below.
Estimating staff time is by some distance the hardest part of the budget, and often when I discuss this with academic colleagues, we end up in a kind of “I dunno, what do you reckon?” impasse. (I should say that it’s me who speaks like that, not them). I’ve never been involved in a research project (other than my ‘desk research’ MPhil), so I’ve really no idea, and I don’t have any particular insight into how long certain tasks will take. Career young academics, and the increasing number of academics who have never had the opportunity to lead on a research project, have little experience to draw upon, and even those who have experience seem to find it difficult. I can understand that, because I’d find it difficult too. If someone where to ask me how estimate how much time I spent over the course of a year on (say) duties related to my role as School Research Ethics Officer, I’d struggle to give them in answer in terms of a percentage FTE or in terms of a total number of working days.
It’s further complicated by the convenient fiction that academic staff work the standard five day weeks, and 37.5 hour working weeks. Even those who don’t regularly work evenings and weekends will almost certainly have flexible working patterns that make it even harder to estimate how long something will take. This means that the standard units of staff time that are most often used – total days and percentage of full time – aren’t straightforwardly convertible from one currency to the other. To make matters worse, some European funding sources seem to prefer ‘person months’. Rather than the standard working week, I think this probably reflects the reality of academic work in many institutions:
The response to my question about how much time the project will take is often answered with another question. What will the funder pay for? What looks right? What feels right? Longer, thinner project, or shorter and more intensive? The answer is always and inevitably, ‘it depends’. It depends upon what is right for the project. A longer less intensive project might make sense if you have to wait for survey responses to come in, or for other things to happen. On the other hand, if it’s something that you can and want to work on intensively, go for it. But the project has to come first. What would it take to properly take on this research challenge?
Often the answer is a bit hand-wavy and guesstimate-ish. Oh, I don’t know….say… about, two days per week? Two and a half? Would they fund three? This is a generally a good starting point. What’s not a good starting point is the kind of fifteen-minutes-every-Tuesday approach, where you end up with a ‘salami project’ – a few people involved, but sliced so thinly it’s hard to see how anything will get done. This just isn’t credible, and it’s very unlikely to get funded by the likes of the ESRC (and other funders too, I’m sure) if they don’t believe that you’ll possibly be able to deliver for the amount of money (time) you’re asking for. Either they’ll conclude that you don’t understand what your own research requires (which is fatal for any chance of funding), or they’ll think that you’re trying to pull a fast one in terms of the value for money criterion. And they won’t like that much either.
The other way to make sure that you’re not going to get funded is to go the other way and become greedy. I’ve noticed that – oddly – academics seldom over-estimate their own time, but over-estimate the amount of researcher time required. I’ve seen potential bids before now that include a heavy smattering of research associates, but no clear idea what it actually is they’ll be doing all day, other than doing stuff that the lead investigator doesn’t want to do. In a UK context, overheads are calculated on the basis of investigator and researcher time, so including researchers is doubly expensive. One way round this that I often recommend is to ensure that what’s required is actually a research associate (who attracts overheads) rather than an academic-related project manager or administrator (who doesn’t). But if it’s hard to estimate how long it will take you to do any given task, it’s doubly hard to estimate how long it will take someone else – usually someone less experienced and less skilled – and perhaps from a cognate sub-discipline rather than from your own.
My usual advice is for would-be principal investigators to draw up a table showing the various phases of the project as rows, and project staff as columns. In addition to the main phases of the research, extra rows should be added for the various stages of dissemination and impact activity; for project coordination with colleagues; for line management of any researchers or administrative/managerial staff; for professional development where appropriate. Don’t forget travelling time associated with meetings, fieldwork, conferences etc. The main thing that I usually see underestimated is project management time. As principal investigator, you will have to meet reasonably regularly with your finance people, and you’ll have to manage and direct the project research associates. Far too many academics seem to see RAs as clones who will instinctively know what to do and don’t need much in the way of direction, advice, or feedback.
Once this is done, I suggest adding up the columns and then working backwards from those total numbers of project days to a percentage FTE, or days per week, or whatever alternative metric you prefer. In the UK, the research councils assuming that 220 days = 1 working year, so you can use this to calculate the percentage of full time. The number that you come out with should feel intuitively about right. If it doesn’t, then something has probably gone wrong. Go back to the table, and adjust things a little. By going to and fro, from the precision of the table to the intuition of the percentage of time, you should reach what my philosophical hero and subject of my thesis, John Rawls, called ‘reflective equilibrium’. Though he wasn’t talking about investigator time. Once you’re happy with the result, you should probably use the figure from the table, and you should certainly consider putting the table in full in the ‘justification for resources’ section.
Something I’m starting at the moment as part of the end-of-project review process is to go back to the original estimates of staff time, and to get a sense from the research team about how accurate they were, and what they would estimate differently next time, if anything. The two things that have come out strongly from this so far I’ve outlined above – managing staff and project administration – but I’ll be looking for others.
So…. over to you. How do you estimate researcher and investigator time? Have you been involved in a funded project? If so, what did you miss in your forecasts (if anything)? What would you do differently next time?
