{"id":84,"date":"2011-07-25T18:46:04","date_gmt":"2011-07-25T17:46:04","guid":{"rendered":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84"},"modified":"2011-07-26T08:22:48","modified_gmt":"2011-07-26T07:22:48","slug":"it%e2%80%99s-a-bad-review-we-got-a-bad-review-%e2%80%a6oh-lord","status":"publish","type":"post","link":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84","title":{"rendered":"&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;"},"content":{"rendered":"<figure id=\"attachment_88\" aria-describedby=\"caption-attachment-88\" style=\"width: 300px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-88 \" title=\"Clactonpier\" src=\"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier-300x185.jpg\" alt=\"A picture of Clacton Pier\" width=\"300\" height=\"185\" srcset=\"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier-300x185.jpg 300w, https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier.jpg 838w\" sizes=\"auto, (max-width: 300px) 85vw, 300px\" \/><figcaption id=\"caption-attachment-88\" class=\"wp-caption-text\">A large sandpit and a pier (re)view<\/figcaption><\/figure>\n<p>A healthy portion of food for thought has been served up by the publication of a <a href=\"http:\/\/www.rand.org\/randeurope.html\" target=\"_blank\">RAND Europe<\/a> report into <a title=\"Report (pdf)\" href=\"http:\/\/www.rand.org\/content\/dam\/rand\/pubs\/technical_reports\/2011\/RAND_TR1010.pdf\" target=\"_blank\">alternatives to peer review for research project funding<\/a>.\u00a0 Peer review is something that I &#8211; as an alleged research funding professional -have rather taken for granted as being the natural and obvious way to allocate (increasingly) scarce resources.\u00a0 How do we decide who gets funded?\u00a0 Well, let&#8217;s ask experts to report, and then make a judgement based upon what those experts say.\u00a0 I&#8217;ve been aware of other ways, but I&#8217;ve not given them much thought &#8211; I&#8217;m a poacher, not a gamekeeper.<\/p>\n<p>The <a href=\"http:\/\/www.guardian.co.uk\/higher-education-network\" target=\"_blank\">Guardian Higher Education Network<\/a> ran a <a href=\"http:\/\/www.guardian.co.uk\/higher-education-network\/poll\/2011\/jul\/20\/research-academics\" target=\"_blank\">poll<\/a> over the second half of last week, and a whopping 70.8% of those who voted <del>said that they had had a research proposal turned down<\/del>\u00a0 thought the process should be changed.\u00a0 I&#8217;m aware of the limitations of peer review -it&#8217;s only as good as the peers, and the effort they&#8217;re prepared to make and the care they&#8217;re prepared to take with their review.\u00a0 Anyone who has had any involvement in research funding will be aware of examples where comments come back that are frankly baffling: drawing odd conclusions, obsessing over irrelevancies, wanting the research to be about something else, making unsupported statements, or assertions that are just demonstrably false.<\/p>\n<p><iframe loading=\"lazy\" src=\"http:\/\/www.youtube.com\/embed\/3B9-wdaxV7Y?rel=0\" frameborder=\"0\" width=\"425\" height=\"349\"><\/iframe><\/p>\n<p>[Personally, I hate it when &#8216;Reviewer Q&#8217; remarks that the project &#8220;seems expensive&#8221;, without further comment or justification about <em>what&#8217;s<\/em> too expensive.\u00a0 That&#8217;s our carefully crafted budget you&#8217;re talking about there, Reviewer Q.\u00a0 It&#8217;s meticulously pedantic, and pedantically meticulous.\u00a0 We&#8217;ve Justified our Resources&#8230; so how about you justify your comment?\u00a0 I wonder how annoyed I&#8217;d get if I wrote the whole application&#8230;..]<\/p>\n<p>One commentator on the Guardian poll page, <em>dianthusmed<\/em>, said that<\/p>\n<blockquote><p>Anyone voting to change the peer review process, I will not take you seriously unless you tell me what you&#8217;d replace it with.<\/p><\/blockquote>\n<p>And that&#8217;s surely the $64,000 question (at 80% fEC)&#8230;. we&#8217;re all more or less familiar with the potential shortcomings of peer review as a method of allocating funding, but if not peer review&#8230; then what?<\/p>\n<p>In fact, the Rand Europe report is not an anti peer-review polemic, and deserves a more nuanced response than a &#8220;peer review: yes or no&#8221; on-line poll.\u00a0 The only sensible answer, surely, is: well, it depends what you want to achieve.\u00a0 The report itself aims to<\/p>\n<blockquote><p>inspire thinking amongst research funders by showing how the research funding review process can be changed, and to give funders the confidence to try novel methods by explaining where and how such approaches have been used previously.<\/p><\/blockquote>\n<p>But crucially&#8230;<\/p>\n<blockquote><p>This is not intended to replace peer review, which remains the best method for review of grant applications in many situations. Rather, we hope that by considering some of the alternatives to peer review, where appropriate, research funders will be able to support a wider portfolio of projects, leading to more innovative, high-impact work.<\/p><\/blockquote>\n<p>A number of the options in the report seem to be more related to changing the nature and scope for calls for proposals than changing the nature of peer review itself &#8211; many in ways that aren&#8217;t unfamiliar.\u00a0 But I&#8217;d like to pick out one idea for particular comment: sand pits.<\/p>\n<p>I believe the origin of the term is from computing, where the term &#8216;sand box&#8217; or &#8216;sand pit&#8217; was used to describe an area for experimentation or testing, where no damage could be done to the overall system architecture.\u00a0 I guess the notion of harmless &#8211; even playful &#8211; experimentation is what advocates have in mind.<\/p>\n<p>They sound like a very interesting idea &#8211; get a group of people with expertise to bring to bear on a particular problem, put them all in same place for a day, or a number of days, and see what emerges from discussions.\u00a0 It&#8217;s not really caught on yet in the social sciences, although social scientists have been involved, of course.\u00a0 The notion of cooperating rather than competing, and of new research collaborations forming, is an interesting and an appealing idea.\u00a0 As a way of bringing new perspectives to bear on a particular problem &#8211; especially an interdisciplinary problem &#8211; it looks like an attractive alternative.<\/p>\n<p>There are problems, though.\u00a0 If there are more applications to participate than there are places, there will inevitably need to be choices made and applications accepted and rejected.\u00a0 I would imagine that questions of fit and balance would be relevant as well as questions of experience and expertise, but someone or some group of people will have to make choices.\u00a0 From the application forms I&#8217;ve seen, this is often on the basis of short CV and a short statement.\u00a0 So&#8230; don&#8217;t we end up relying on some element of peer review anyway?<\/p>\n<p>Secondly, I wonder about equal opportunities.\u00a0 If a sand pit event is to take place over several days in a hotel, it will inevitably be difficult or even impossible for some to attend. Those who are parents and\/or carers. Those who have timetabled lectures and tutorials.\u00a0 Those who have other professional or personal diary commitments that just can&#8217;t be moved.\u00a0 For a standard peer reviewed call, no-one is excluded completely because it clashes with an important family event.\u00a0 Can we be sure that all of the best researchers will even apply?<\/p>\n<p>I should say that I&#8217;ve never attended a sandpit event, but I have attended graduate recruitment\/selection events (offered, deferred, and finally declined, since you ask), and residential training courses.\u00a0 They&#8217;re all strange situations where both competitive and cooperative behaviours are rewarded, and I wonder how people react.\u00a0 If I were a funder, I&#8217;d be worried that the prizes might be going to the best social operators, rather than those with the best ideas.\u00a0 It&#8217;s a myth that academic brilliance is always found in inverse proportion to social skills, of course, but even so, my concern would be about whether one or more dominant figures could ending up forming projects around themselves. I also wonder about existing cliques or vested interests of whatever kind having a disproportionate influence.<\/p>\n<p>I&#8217;m sure that effective facilitation and chairing can go a long way to minimising at least some of the potential problems, and while I think sandpits are an intriguing and promising alternative to peer review, they&#8217;re not without problems of their own.\u00a0 I&#8217;d be very interested to hear from anyone who&#8217;s attended a sandpit &#8211; am I doing them a disservice here?<\/p>\n<p>Although I&#8217;m open to other ideas for distributing research funding &#8211; by all means, let&#8217;s be creative, and let&#8217;s look at alternatives &#8211; I don&#8217;t see a replacement for peer review.\u00a0 Which isn&#8217;t to say that there isn&#8217;t scope to improve the quality of peer review.\u00a0 Because, Reviewer Q, there certainly is.<em><br \/>\n<\/em><\/p>\n<p>And perhaps that&#8217;s the point that the 70.8% were trying to make.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A healthy portion of food for thought has been served up by the publication of a RAND Europe report into alternatives to peer review for research project funding.\u00a0 Peer review is something that I &#8211; as an alleged research funding professional -have rather taken for granted as being the natural and obvious way to allocate &hellip; <a href=\"https:\/\/socialscienceresearchfunding.co.uk\/?p=84\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[10,13,14],"tags":[],"class_list":["post-84","post","type-post","status-publish","format-standard","hentry","category-frustrations","category-funding-policy","category-hmhb"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"Some brief reflections on the recent RAND Europe report on research funding decision making methods.\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Adam\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/socialscienceresearchfunding.co.uk\/?p=84\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_GB\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Cash for Questions: Research funding, policy and development | Adam Forristal Golberg\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"&quot;It\u2019s a bad review, we got a bad review \u2026oh lord&quot; | Cash for Questions: Research funding, policy and development\" \/>\n\t\t<meta property=\"og:description\" content=\"Some brief reflections on the recent RAND Europe report on research funding decision making methods.\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/socialscienceresearchfunding.co.uk\/?p=84\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2023\/04\/312959992_10158949037327233_8544637444490771312_n.jpg\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2023\/04\/312959992_10158949037327233_8544637444490771312_n.jpg\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2011-07-25T17:46:04+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2011-07-26T07:22:48+00:00\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:site\" content=\"@Cash4Questions\" \/>\n\t\t<meta name=\"twitter:title\" content=\"&quot;It\u2019s a bad review, we got a bad review \u2026oh lord&quot; | Cash for Questions: Research funding, policy and development\" \/>\n\t\t<meta name=\"twitter:description\" content=\"Some brief reflections on the recent RAND Europe report on research funding decision making methods.\" \/>\n\t\t<meta name=\"twitter:creator\" content=\"@Cash4Questions\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier.jpg\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#article\",\"name\":\"\\\"It\\u2019s a bad review, we got a bad review \\u2026oh lord\\\" | Cash for Questions: Research funding, policy and development\",\"headline\":\"&#8220;It\\u2019s a bad review, we got a bad review \\u2026oh lord&#8221;\",\"author\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?author=1#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/#person\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/wp-content\\\/uploads\\\/2011\\\/07\\\/clactonpier.jpg\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84\\\/#articleImage\",\"width\":838,\"height\":517,\"caption\":\"A large sandpit and a pier (re)view with prizes to be won!\"},\"datePublished\":\"2011-07-25T18:46:04+01:00\",\"dateModified\":\"2011-07-26T08:22:48+01:00\",\"inLanguage\":\"en-GB\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#webpage\"},\"articleSection\":\"Frustrations, Funding Policy, HMHB\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=6#listItem\",\"name\":\"Funding\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=6#listItem\",\"position\":2,\"name\":\"Funding\",\"item\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=6\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=13#listItem\",\"name\":\"Funding Policy\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=13#listItem\",\"position\":3,\"name\":\"Funding Policy\",\"item\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=13\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#listItem\",\"name\":\"&#8220;It\\u2019s a bad review, we got a bad review \\u2026oh lord&#8221;\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=6#listItem\",\"name\":\"Funding\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#listItem\",\"position\":4,\"name\":\"&#8220;It\\u2019s a bad review, we got a bad review \\u2026oh lord&#8221;\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?cat=13#listItem\",\"name\":\"Funding Policy\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/#person\",\"name\":\"Adam\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#personImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/622f49284c2acd27e4c4800df62244b4a7af8f79c4e62e035be25b724564f8de?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"Adam\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?author=1#author\",\"url\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?author=1\",\"name\":\"Adam\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#authorImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/622f49284c2acd27e4c4800df62244b4a7af8f79c4e62e035be25b724564f8de?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"Adam\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#webpage\",\"url\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84\",\"name\":\"\\\"It\\u2019s a bad review, we got a bad review \\u2026oh lord\\\" | Cash for Questions: Research funding, policy and development\",\"description\":\"Some brief reflections on the recent RAND Europe report on research funding decision making methods.\",\"inLanguage\":\"en-GB\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?p=84#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?author=1#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/?author=1#author\"},\"datePublished\":\"2011-07-25T18:46:04+01:00\",\"dateModified\":\"2011-07-26T08:22:48+01:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/#website\",\"url\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/\",\"name\":\"Cash for Questions: Research funding, policy and development\",\"description\":\"Adam Forristal Golberg\",\"inLanguage\":\"en-GB\",\"publisher\":{\"@id\":\"https:\\\/\\\/socialscienceresearchfunding.co.uk\\\/#person\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"\"It\u2019s a bad review, we got a bad review \u2026oh lord\" | Cash for Questions: Research funding, policy and development","description":"Some brief reflections on the recent RAND Europe report on research funding decision making methods.","canonical_url":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#article","name":"\"It\u2019s a bad review, we got a bad review \u2026oh lord\" | Cash for Questions: Research funding, policy and development","headline":"&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;","author":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?author=1#author"},"publisher":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/#person"},"image":{"@type":"ImageObject","url":"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier.jpg","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84\/#articleImage","width":838,"height":517,"caption":"A large sandpit and a pier (re)view with prizes to be won!"},"datePublished":"2011-07-25T18:46:04+01:00","dateModified":"2011-07-26T08:22:48+01:00","inLanguage":"en-GB","mainEntityOfPage":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#webpage"},"isPartOf":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#webpage"},"articleSection":"Frustrations, Funding Policy, HMHB"},{"@type":"BreadcrumbList","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk#listItem","position":1,"name":"Home","item":"https:\/\/socialscienceresearchfunding.co.uk","nextItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6#listItem","name":"Funding"}},{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6#listItem","position":2,"name":"Funding","item":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6","nextItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13#listItem","name":"Funding Policy"},"previousItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13#listItem","position":3,"name":"Funding Policy","item":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13","nextItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#listItem","name":"&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;"},"previousItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6#listItem","name":"Funding"}},{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#listItem","position":4,"name":"&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;","previousItem":{"@type":"ListItem","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13#listItem","name":"Funding Policy"}}]},{"@type":"Person","@id":"https:\/\/socialscienceresearchfunding.co.uk\/#person","name":"Adam","image":{"@type":"ImageObject","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#personImage","url":"https:\/\/secure.gravatar.com\/avatar\/622f49284c2acd27e4c4800df62244b4a7af8f79c4e62e035be25b724564f8de?s=96&d=mm&r=g","width":96,"height":96,"caption":"Adam"}},{"@type":"Person","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?author=1#author","url":"https:\/\/socialscienceresearchfunding.co.uk\/?author=1","name":"Adam","image":{"@type":"ImageObject","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#authorImage","url":"https:\/\/secure.gravatar.com\/avatar\/622f49284c2acd27e4c4800df62244b4a7af8f79c4e62e035be25b724564f8de?s=96&d=mm&r=g","width":96,"height":96,"caption":"Adam"}},{"@type":"WebPage","@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#webpage","url":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84","name":"\"It\u2019s a bad review, we got a bad review \u2026oh lord\" | Cash for Questions: Research funding, policy and development","description":"Some brief reflections on the recent RAND Europe report on research funding decision making methods.","inLanguage":"en-GB","isPartOf":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/#website"},"breadcrumb":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84#breadcrumblist"},"author":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?author=1#author"},"creator":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/?author=1#author"},"datePublished":"2011-07-25T18:46:04+01:00","dateModified":"2011-07-26T08:22:48+01:00"},{"@type":"WebSite","@id":"https:\/\/socialscienceresearchfunding.co.uk\/#website","url":"https:\/\/socialscienceresearchfunding.co.uk\/","name":"Cash for Questions: Research funding, policy and development","description":"Adam Forristal Golberg","inLanguage":"en-GB","publisher":{"@id":"https:\/\/socialscienceresearchfunding.co.uk\/#person"}}]},"og:locale":"en_GB","og:site_name":"Cash for Questions: Research funding, policy and development | Adam Forristal Golberg","og:type":"article","og:title":"&quot;It\u2019s a bad review, we got a bad review \u2026oh lord&quot; | Cash for Questions: Research funding, policy and development","og:description":"Some brief reflections on the recent RAND Europe report on research funding decision making methods.","og:url":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84","og:image":"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2023\/04\/312959992_10158949037327233_8544637444490771312_n.jpg","og:image:secure_url":"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2023\/04\/312959992_10158949037327233_8544637444490771312_n.jpg","article:published_time":"2011-07-25T17:46:04+00:00","article:modified_time":"2011-07-26T07:22:48+00:00","twitter:card":"summary","twitter:site":"@Cash4Questions","twitter:title":"&quot;It\u2019s a bad review, we got a bad review \u2026oh lord&quot; | Cash for Questions: Research funding, policy and development","twitter:description":"Some brief reflections on the recent RAND Europe report on research funding decision making methods.","twitter:creator":"@Cash4Questions","twitter:image":"https:\/\/socialscienceresearchfunding.co.uk\/wp-content\/uploads\/2011\/07\/clactonpier.jpg"},"aioseo_meta_data":{"post_id":"84","title":"&quot;It\u2019s a bad review, we got a bad review \u2026oh lord&quot; | #site_title","description":"Some brief reflections on the recent RAND Europe report on research funding decision making methods.","keywords":[{"label":"RAND Corporation","value":"RAND Corporation"},{"label":"Peer Review","value":"Peer Review"},{"label":"sand pit","value":"sand pit"},{"label":"sand box","value":"sand box"},{"label":"RAND Europe","value":"RAND Europe"}],"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"breadcrumb_settings":null,"limit_modified_date":false,"ai":null,"created":"2020-12-20 21:36:30","updated":"2025-06-03 22:53:37","seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/socialscienceresearchfunding.co.uk\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6\" title=\"Funding\">Funding<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13\" title=\"Funding Policy\">Funding Policy<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t\u201cIt\u2019s a bad review, we got a bad review \u2026oh lord\u201d\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/socialscienceresearchfunding.co.uk"},{"label":"Funding","link":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=6"},{"label":"Funding Policy","link":"https:\/\/socialscienceresearchfunding.co.uk\/?cat=13"},{"label":"&#8220;It\u2019s a bad review, we got a bad review \u2026oh lord&#8221;","link":"https:\/\/socialscienceresearchfunding.co.uk\/?p=84"}],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p1OLY1-1m","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/84","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=84"}],"version-history":[{"count":36,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/84\/revisions"}],"predecessor-version":[{"id":121,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/84\/revisions\/121"}],"wp:attachment":[{"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=84"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=84"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/socialscienceresearchfunding.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=84"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}