1445581641-featured.jpeg
Dave Snowden

It is never that simple

RSS Feed

If you read the report I referenced in yesterday’s post you will find multiple claims that there is growing evidence that mindfulness has a major impact on health and well being. By coincidence I came across a New York Times article this morning reporting that “a team of filmmakers led by a British cardiologist say that the function of the Mediterranean diet may have been oversimplified. They contend in a new film that the region’s good health is driven not only by food, but by an array of lifestyle factors, some of which they claim have been overlooked“. Now this may or may not be accurate but it points out the danger of confusing correlation with causation. Also the related danger of confusing symptoms with causes.

Both of these confusions are all to common in in the fields of evidence based policy and snake oil purveyance consultancy methods, and we can add a third issue namely the danger of biasing the results based on commissioning expectations. As an aside here, I have long thought that the absence of debating from schools and universities is one of the factors which has generally reduced the capacity of people to exercise critical reason. Not just performing by the way, but listening. My pet rant over lets look at the three issues.

  1. Confusing correlation with causation may itself result from physics envy, but it is a real problem in management science.  Even satire can’t debunk this issue and there is some evidence that is part of what we are as a species and is more likely when aspects are presented in a distinctive or unusual way; a feature all too common in presenting the latest magic pill.  Aside from an illusory correlation it may well be that thing cause and effect themselves arise from some other factor.  So taking up meditation improves someone’s mental health; but it may be that the decision to do something is more important  than the thing chose.  So walking, cycling or changing social interaction could have had an equal impact.  In fact it may be many things in combination.   
  2. The symptoms and cause confusion has always been more dangerous in method development.   I have long used the example of confusing creativity with innovation; the former is a symptom of the latter.  But if we focus on an observational/deductive model of research its a danger.  All these people have been innovation, they are also creative so if we make people creative they will be innovative.   Healthy people meditate, so if we meditate we will be healthy and so on.  Life really is (as the title of this blog suggests) that simple.  Multiple causes or rather dispositional states with varying modulators are key to understanding complex systems no linear models of single point causality.
  3. My third danger is more perfidious and impacts on a lot of commissioned reports.  So a government department is looking at mindfulness to deal with more motivational factors  and they commission research to see if there is an evidence base.  The organisation awarded the contract already knows what the goal is and they focus their search on material that links mindfulness to motivation which means a partial selection from the field and a reading which is predisposed to a conclusion.  Especially as these days in research the junior staff may have less that five teen minutes to skim each article in a search and draw conclusions.   Evidence based policy has become an industry in its own right, more policy based evidence these days.

In a multi-causal system we need to run multiple parallel interventions which have some basis in science (where we can do repeated tests of hypotheses). This is the test for coherence, then patterns or dispositions of behaviour will start to emerge which may or may not shift things in the right direction in a specific context. Evidence itself is an emergent property in a complex system. The only magic pills available have a correlation with cash not cure ….

  • James

    I always enjoy the ongoing commenntary, discussion and many examples of the various ‘fluffy-bunny’ pseudo-scientific, rah rah business offerings including 3-stage accreditation courses with digital badges and certificates to hang on the web-site or wall of the consultancy practice. Thank you, helps so much in discussions with the hopeful and fanciful to have evidence-based ideas to offer up. Such a demand from people who would like to leave others in charge of their futures rather than seeing the future potential in their every day for themselves – and choosing their own futures.

    I am returning the favour and offering up some local ‘scientifically evidenced’ information on some of the dangerous and harmful downside of the exploding Mindfulness industry.

    An article from yesterdays Australian Financial Review, p45. ‘Mindfulness not what the doctor ordered’, by Jill Margo under the section ‘Men’s Health’. Jill is an adjunct associate professor at the University of NSW. (New South Wales – the English exporting bits of their conquests to the antipodes!!)

    Here: http://www.afr.com/business/health/mindfulness-under-the-microscope–it-doesnt-work-for-everyone-20170305-gurdct

    If you type in the article title you can read it online.

    Jill quotes a number of studies, one by Griffith University and Cancer Council Queensland, involving almost 200 men living with advanced cancer showed mindfiulness didn’t help them. It’s authors also speculate it may cause harm. This study is published in the Journal of Clinical oncology. She further quotes ‘…underscores the dangers of naive realism in clinical practice’ and ‘it is now increasingly directed by commercial interests and naive realism, with clinicians using intuition rather than evidence to assess its effectiveness’.

    Jill also quotes the secretary of the International Psycho-Oncology Society and professor of social science at the University of Southern Queensland, Jeff Dunn ‘A concern is that mindfulness has been turned into a commodity to meet consumer demand…sliced off a broadly based philosophy and commodified to suit market trends’. And ‘Whats the correct dose for each situation and what quality control do we have?…its one thing for business executives to pursue mindfullness retreats to enhance their performance…it is quite another when mindfulness is delivered to vulnerable people with life threatening diseases.’

    Jill also quotes the authors of the book ‘The Buddha Pill’, psychologists Miguel Farias and Catherine Wikholm, who examined the science of meditation and the delusions of personal change.apparently after studying over 45 years ofscientific literature, they realised with astonishment that it’s not known how meditation works, who benefits the most or the least and how long the effects last.

    Useful evidence-based perspectives. Begs a title for a leadership book to rival ‘good-to-great’, perhaps ‘Sit and Wait’.

    Regards

    James Gillespie

Top