{"id":55,"date":"2012-01-19T07:52:00","date_gmt":"2012-01-19T07:52:00","guid":{"rendered":"http:\/\/touching-the-real.therapeia.org.uk\/wp\/?p=55"},"modified":"2012-01-19T07:52:00","modified_gmt":"2012-01-19T07:52:00","slug":"evidence-and-science","status":"publish","type":"post","link":"https:\/\/therapeia.org.uk\/ttr\/2012\/01\/19\/evidence-and-science\/","title":{"rendered":"Evidence and science"},"content":{"rendered":"<p>It was interesting to watch <em>Sherlock<\/em> the other night, i.e. the BBC\u2019s \u2018updating\u2019 of Conan Doyle\u2019s famous detective stories into the twenty first century with Benedict Cumberbatch starring as the sleuth in question.\u00a0 What particularly fascinated me, apart from the liberties that this &#8216;new\u2019 version was taking with the plots (but that\u2019s nothing new of course), was the portrayal of our twentieth first century Holmes as someone with incredible powers of observation and deduction.\u00a0 In a glance Holmes can tell a person\u2019s life story (or at least what they were doing the night before).\u00a0 How does he do this?\u00a0 First he sees: he sees what other fail to see, the detail, the minutiae of a person\u2019s appearance.\u00a0 However, mere observation is not enough.\u00a0 But, of course, Holmes does more: he sees and then he deduces.\u00a0 He deduces from a set of observations something about the person, the criminal.\u00a0 He knows what they are like, what they are likely to do next (apart from his nemesis Moriarty of course).<\/p>\n<p>What has this got to do with psychoanalysis?\u00a0 What, indeed has this got to do with evidence and science?\u00a0 To answer the second question first.\u00a0 For many people, Sherlock Holmes is the archetypal scientist.\u00a0\u00a0 Not only does he turn detective work into a science, but in a sense he is a model for the scientific method \u2013 or rather, what many people think the scientific method is.\u00a0 You observe and you draw conclusions.\u00a0\u00a0 So Holmes, in all his incarnations over the years, is the archetypal empiricist.<\/p>\n<p>The problem is, this is a myth, a fantasy.\u00a0 It has nothing to do with how science actually works.\u00a0 To start with there is a probably of semantics: can you <em>deduce<\/em> anything from an <em>observation<\/em>?\u00a0 Deduction is a logical process that reaches a conclusion based on propositions.\u00a0\u00a0 But these are statements written in some form of language, either natural or mathematical.\u00a0\u00a0\u00a0 Of course,\u00a0 you can \u2018translate\u2019 empirical observations into logical propositions, which is precisely what the logical positivists aimed to do.\u00a0 But these propositions have very little to do with the original observation.<\/p>\n<p>If anything, Holmes was an <em>inductivist. <\/em>\u00a0 This another way of saying that he made certain assumptions based on his observations, which has got nothing to do with deductive logic.\u00a0 As an inductivist Holmes would, at least mentally, be calculating the probability that a particular observation meant something particular about the subject in question.\u00a0 He may even have been carrying out a series of mental hypotheses to test a particular theory about the subject.\u00a0\u00a0 Of course none of this makes a good detective story or gripping TV.<\/p>\n<p>But if we stay with the idea that Holmes is an inductivist then he is not that far away from what many psychologists do when they are formulating theories.\u00a0 However, psychologists, in an attempt emulate what they think \u2018real\u2019 scientists, i.e. physicists, do, endeavour to be more formalised than Holmes.\u00a0 They try to carry out controlled experiments, i.e. through controlling a set of variables.\u00a0 They then record the results of such experiments and subject them to statistical analysis.<\/p>\n<p>The problem for psychologists, however, is that it\u2019s often very difficult to conduct controlled experiments with their human subjects \u2013 though there are many (in)famous examples of this being carried out over the years.\u00a0 Human beings have a nasty habit of being unpredictable and even exercising free will at the most awkward of moments.\u00a0 When it comes to trying to evaluate how effective a particular form of talking treatment is things get even more complicated.\u00a0 How can you conduct a controlled experiment of a very intimate relationship?\u00a0 You don\u2019t.\u00a0 You do the next best thing and conduct a randomised controlled trial (RCT).\u00a0 This is a well established methodology in medicine, used widely, for example, in the testing of new drugs.\u00a0 You have two groups.\u00a0 One is administered the drug and the other, the control group, is administered a placebo.\u00a0\u00a0 Of course, no in either group actually knows whether they are receiving the real drug or a placebo.\u00a0 All other variables are carefully controlled.<\/p>\n<p>The results of such a quasi experiment are carefully monitored and subject to a range of statistical analyses.\u00a0\u00a0 This way the person conducting the RCT can gain a pretty good (statistical) sense of whether the drug was effective or not.\u00a0 When it comes to talking treatments thing are more tricky, because it becomes more difficult to \u2018operationalise\u2019 the interventions and to control the \u2018variables\u2019 of the therapist\u2019s and client\u2019s behaviour.\u00a0 One way round this is to do a meta-analysis of a range of RCTs, which, as the name suggests, involves an even higher degree of statistical abstraction.\u00a0 We seem to have travelled a long way from the naive empiricism of Sherlock Holmes.\u00a0 In fact we\u2019ve arrived at evidence-based practice and the process by which NICE (the National Institute for Health and Clinical Excellence \u2013 no one knows what happened to the \u2018H&#8217; in the acronym)\u00a0 decides whether a particular talking treatment is efficacious, i.e. whether it works or not.<\/p>\n<p>I think it should be pretty clear by now that the kind of \u2018evidence\u2019 that it being constructed (and I use this word deliberately) through the process of RCTs and meta analyses is anything but a series of observations of the \u2018outside\u2019 world or even of a person\u2019s behaviour.\u00a0 Instead it is a complex, statistical construction.\u00a0 A great deal of science is.\u00a0 The question is, what does such a complex statistical construction tell us about how individual human beings experience the therapeutic relationship, or how, indeed, they experience anything at all?\u00a0 Very little I would argue.\u00a0 And yet, such complex statistical constructions are being passed off as the \u2018truth\u2019 of the therapeutic encounter.\u00a0 Or rather, they are being used to justify a particular form of therapeutic intervention \u2013 one, perhaps not surprisingly, which lends itself particularly well to randomised controlled trials.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It was interesting to watch Sherlock the other night, i.e. the BBC\u2019s \u2018updating\u2019 of Conan Doyle\u2019s famous detective stories into the twenty first century with Benedict Cumberbatch starring as the sleuth in question.\u00a0 What particularly fascinated me, apart from the liberties that this &#8216;new\u2019 version was taking with the plots &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[8],"tags":[],"class_list":["post-55","post","type-post","status-publish","format-standard","hentry","category-philosophy-and-science"],"acf":[],"_links":{"self":[{"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/posts\/55","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/comments?post=55"}],"version-history":[{"count":0,"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/posts\/55\/revisions"}],"wp:attachment":[{"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/media?parent=55"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/categories?post=55"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/therapeia.org.uk\/ttr\/wp-json\/wp\/v2\/tags?post=55"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}