Friday, 19 September 2014

The 10 most controversial psychology studies ever published

Controversy is essential to scientific progress. As Richard Feynman said, "science is the belief in the ignorance of experts." Nothing is taken on faith, all assumptions are open to further scrutiny. It's a healthy sign therefore that psychology studies continue to generate great controversy. Often the heat is created by arguments about the logic or ethics of the methods, other times it's because of disagreements about the implications of the findings to our understanding of human nature. Here we digest ten of the most controversial studies in psychology's history. Please use the comments to have your say on these controversies, or to highlight provocative studies that you think should have made it onto our list.

1. The Stanford Prison Experiment
Conducted in 1971, Philip Zimbardo's experiment had to be aborted when students allocated to the role of prison guards began abusing students who were acting as prisoners. Zimbardo interpreted the events as showing that certain situations inevitably turn good people bad, a theoretical stance he later applied to the acts of abuse that occurred at the Abu Ghraib prison camp in Iraq from 2003 to 2004. This situationist interpretation has been challenged, most forcibly by the British psychologists Steve Reicher and Alex Haslam. The pair argue, on the basis of their own BBC Prison study and real-life instances of prisoner resistance, that people do not yield mindlessly to toxic environments. Rather, in any situation, power resides in the group that manages to establish a sense of shared identity. Critics also point out that Zimbardo led and inspired his abusive prison guards; that the Stanford Prison Experiment (SPE) may have attracted particular personality types; and that many guards did behave appropriately. The debate continues, as does the influence of the SPE on popular culture, so far inspiring at least two feature length movies.

Zimbardo, P. G. (1972). Comment: Pathology of imprisonment. Society, 9(6), 4-8. Google Scholar Citations: 324.
Haney, C., Banks, W. C., & Zimbardo, P. G. (1973). Study of prisoners and guards in a simulated prison. Naval Research Reviews, 9(1-17). Google Scholar Citations: 216.

2. The Milgram "Shock Experiments"
Stanley Milgram's studies conducted in the 1960s appeared to show that many people are incredibly obedient to authority.  Given the instruction from a scientist, many participants applied what they thought were deadly levels of electricity to an innocent person. Not one study, but several, Milgram's research has inspired many imitations, including in virtual reality and in the form of a French TV show. The original studies have attracted huge controversy, not only because of their ethically dubious nature, but also because of the way they have been interpreted and used to explain historical events such as the supposedly blind obedience to authority in the Nazi era. Haslam and Reicher have again been at the forefront of counter-arguments. Most recently, based on archived feedback from Milgram's participants, the pair argue that the observed obedience was far from blind - in fact many participants were pleased to have taken part, so convinced were they that their efforts were making an important contribution to science. It's also notable that many participants in fact disobeyed instructions, and in such cases, verbal prompts from the scientist were largely ineffective.

Milgram, S. (1963). Behavioral study of obedience. The Journal of Abnormal and Social Psychology, 67(4), 371. Google Scholar Citations: 3474

3. The "Elderly-related Words Provoke Slow Walking" Experiment (and other social priming research)
One of the experiments in a 1996 paper published by John Bargh and colleagues showed that when people were exposed to words that pertained to being old, they subsequently walked away from the lab more slowly. This finding is just one of many in the field of "social priming" research, all of which suggest our minds are far more open to influence than we realise. In 2012, a different lab tried to replicate the elderly words study and failed. Professor Bargh reacted angrily. Ever since, the controversy over his study and other related findings has only intensified. Highlights of the furore include an open letter from Nobel Laureate Daniel Kahneman to researchers working in the area, and a mass replication attempt of several studies in social psychology, including social priming effects. Much of the disagreement centres around whether replication attempts in this area fail because the original effects don't exist, or because those attempting a replication lack the necessary research skills, make statistical errors, or fail to perfectly match the original research design.

Bargh, J. A., Chen, M., & Burrows, L. (1996). Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action. Journal of personality and social psychology, 71(2), 230. Google Scholar Citations: 3276

4. The Conditioning of Little Albert
Back in 1920 John Watson and his future wife Rosalie Rayner deliberately induced fears in an 11-month-old baby. They did this by exposing him to a particular animal, such as a white rat, at the same time as banging a steel bar behind his head. The research is controversial not just because it seems so unethical, but also because the results have tended to be reported in an inaccurate and overly simplified way. Many textbooks claim the study shows how fears are easily conditioned and generalised to similar stimuli; they say that after being conditioned to fear a white rat, Little Albert subsequently feared all things that were white and fluffy. In fact, the results were far messier and more inconsistent than that, and the methodology was poorly controlled. Over the last few years, controversy has also developed around the identity of poor Little Albert. In 2009, a team led by Hall Beck claimed that the baby was in fact Douglas Merritte. They later claimed that Merritte was neurologically impaired, which if true would only add to the unethical nature of the original research. However, a new paper published this year by Ben Harris and colleagues argues that Little Albert was actually a child known as Albert Barger.

Watson, J. B., & Rayner, R. (1920). Conditioned emotional reactions. Journal of Experimental Psychology, 3(1), 1. Google Scholar Citations: 2031

5. Loftus' "Lost in The Mall" Study
In 1995 and '96, Elizabeth Loftus, James Coan and Jacqueline Pickrell documented how easy it was to implant in people a fictitious memory of having been lost in a shopping mall as a child. The false childhood event is simply described to a participant alongside true events, and over a few interviews it soon becomes absorbed into the person's true memories, so that they think the experience really happened. The research and other related findings became hugely controversial because they showed how unreliable and suggestible memory can be. In particular, this cast doubt on so-called "recovered memories" of abuse that originated during sessions of psychotherapy. This is a highly sensitive area and experts continue to debate the nature of false memories, repression and recovered memories. One challenge to the "lost in the mall" study was that participants may really have had the childhood experience of having been lost, in which case Loftus' methodology was recovering lost memories of the incident rather than implanting false memories. This criticism was refuted in a later study (pdf) in which Loftus and her colleagues implanted in people the memory of having met Bugs Bunny at Disneyland. Cartoon aficionados will understand why this memory was definitely false.

Loftus, E. F., & Pickrell, J. E. (1995). The formation of false memories. Psychiatric annals, 25(12), 720-725. Google Scholar Citations: 677
Loftus, E. F., Coan, J. A., & Pickrell, J. E. (1996). Manufacturing false memories using bits of reality. Implicit memory and metacognition, 195-220. Google Scholar Citations: 71
Loftus, E. F. (1993). The reality of repressed memories. American psychologist, 48(5), 518. Google Scholar Citations: 1413

6. The Daryl Bem Pre-cognition Study
In 2010 social psychologist Daryl Bem attracted huge attention when he claimed to have shown that many established psychological phenomena work backwards in time. For instance, in one of his experiments, he found that people performed better at a memory task for words they revised in the future. Bem interpreted this as evidence for pre-cognition, or psi - that is, effects that can't be explained by current scientific understanding. Superficially at least, Bem's methodology appeared robust, and he took the laudable step of making his procedures readily available to other researchers. However, many experts have since criticised Bem's methods and statistical analyses (pdf), and many replication attempts have failed to support the original findings. Further controversy came from the the fact that the journal that published Bem's results refused at first to publish any replication attempts. This prompted uproar in the research community and contributed to what's become known as the "replication crisis" or "replication wars" in psychology. Unabashed, Bem published a meta-analysis this year (an analysis that collated results from 90 attempts to replicate his 2010 findings) and he concluded that overall there was solid support for his earlier work. Where will this controversy head next? If Bem's right, you probably know the answer already.

Bem, D. J. (2011). Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect. Journal of personality and social psychology, 100(3), 407. Google Scholar Citations: 276

7. The Voodoo Correlations in Social Neuroscience study
This paper was released online before print, where it initially bore the provocative title "Voodoo correlations in social neuroscience". Voodoo in this sense meant non-existent or spurious. Ed Vul and his colleagues had analysed over 50 studies that linked localised patterns of brain activity with specific aspects of behaviour or emotion, such as one that reported feelings of rejection were correlated highly with activity in the anterior cingulate cortex. Vul and his team said the high correlations reported in these papers were due to the use of inappropriate analyses - a form of "double-dipping" in which researchers took two or more steps: first identifying a region, or even a single voxel, linked with a certain behaviour, and then performing further analyses on just that area. The paper caused great offence to the many brain imaging researchers in social neuroscience whose work had been targeted. "Several of [Vul et al's] conclusions are incorrect due to flawed reasoning, statistical errors, and sampling anomalies," said the authors of one rebuttal paper. However, concerns about the statistical analyses used in imaging neuroscience haven't gone away. For example, in 2012 Joshua Carp wrote a paper claiming that most imaging papers fail to provide enough methodological detail to allow others to attempt replications.

Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspectives on psychological science, 4(3), 274-290. Google Scholar Citations: 688.

8. The Kirsch Anti-Depressant Placebo Effect Study
In 2008 Irving Kirsch, a psychologist who was then based at the University of Hull in the UK, analysed all the trial data on anti-depressants, published and unpublished, submitted to the US Food and Drug Administration. He and his colleagues concluded that for most people with mild or moderate depression, the extra benefit of anti-depressants versus placebo is not clinically meaningful.  The results led to headlines like "Depression drugs don't work" and provided ammunition for people concerned with the overprescription of antidepressant medication. But there was also a backlash. Other experts analysed Kirsch's dataset using different methods and came to different conclusions. Another group made similar findings to Kirsch, but interpreted them very differently - as showing that drugs are more effective than placebo. Kirsch is standing his ground. Writing earlier this year, he said: "Instead of curing depression, popular antidepressants may induce a biological vulnerability making people more likely to become depressed in the future."

Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008). Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS medicine, 5(2), e45. Google Scholar Citations: 1450.

9. Judith Rich Harris and the "Nurture Assumption"
You could fill a library or two with all the books that have been published on how to be a better parent. The implicit assumption, of course, is that parents play a profound role in shaping their offspring. Judith Rich Harris challenged this idea with a provocative paper published in 1995 in which she proposed that children are shaped principally by their peer groups and their experiences outside of the home. She followed this up with two best-selling books: The Nurture Assumption and No Two Alike. Writing for the BPS Research Digest in 2007, Harris described some of the evidence that supports her claims: "identical twins reared by different parents are (on average) as similar in personality as those reared by the same parents ... adoptive siblings reared by the same parents are as dissimilar as those reared by different parents ... [and] ... children reared by immigrant parents have the personality characteristics of the country they were reared in, rather than those of their parents' native land." Harris has powerful supporters, Steven Pinker among them, but her ideas also unleashed a storm of controversy and criticism. "I am embarrassed for psychology," Jerome Kagan told Newsweek after the publication of Harris' Nurture Assumption.

Harris, J. R. (1995). Where is the child's environment? A group socialization theory of development. Psychological review, 102(3), 458. Google Scholar Citations: 1535

10. Libet's Challenge to Free Will

Your decisions feel like your own, but Benjamin Libet's study using electroencephalography (EEG) appeared to show that preparatory brain activity precedes your conscious decisions of when to move. One controversial interpretation is that this challenges the notion that you have free will. The decision of when to move is made non-consciously, so the argument goes, and then your subjective sense of having willed that act is tagged on afterwards. Libet's study and others like it have inspired deep philosophical debate. Some philosophers like Daniel Dennett believe that neuroscientists have overstated the implications of these kinds of findings for people's conception of free will. Other researchers have pointed out flaws in Libet's research, such as people's inaccuracy in judging the instant of their own will. However, the principle of non-conscious neural activity preceding conscious will has been replicated using fMRI, and influential neuroscientists like Sam Harris continue to argue that Libet's work undermines the idea of free will.

Libet, B., Gleason, C. A., Wright, E. W., & Pearl, D. K. (1983). Time of conscious intention to act in relation to onset of cerebral activity (readiness-potential) the unconscious initiation of a freely voluntary act. Brain, 106(3), 623-642. Google Scholar Citations: 1483

Where do you stand on the implications and interpretations of these 10 psychology studies/theories? Which controversial studies do you think should have made it onto our list?

Post written by Christian Jarrett (@psych_writer) for the BPS Research Digest.


Research Digest said...

Another good article, I thought you retired from this post? good you haven't - Owen

Research Digest said...

thanks Owen! Yes, I'm back (like a rubber ball / bad penny)

Research Digest said...

A boasty paper title for such a weak methodology!

Research Digest said...

Yes. Your subconscious is assessing in the background how long to wait before pressing the button. It even has some guiding parameters--not too soon, but not so long that it seems unreasonable on some level. Gradually a sense of urgency builds, which is transmitted to your muscles (the electrical stimulation seen in the studies) until you feel nudged to consciously press the button. It is the opposite of the common interpretation. They are actually seeing the subconscious decision making process--free will in action--not lack of free will preceding conscious choice. It's like a background free will thread being spun off to cue thee conscious decision that is made and it's also reflected in the muscles.

Research Digest said...

It seems like psychology needs a few more lessons in probability and statistics... One thing that seems odd is the amount of mathematical, statistical, and computational knowledge seems much greater among those in the natural sciences while those in the social sciences - one could argue - are the ones that research subjects and events that behave in a much wilder fashion. I know, I know, statistical mechanics and the uncertainty of the "quantum" world but think about it. Economists studying markets - wildly random. Psychologists studying what ultimately amounts to the human brain and its effect on our behavior - insanely complex. Its possible that I have no idea what I am talking about as I must admit I am not a psychologist. However, I know Kahneman would agree with me, after all, he did the study. That is unless, as a psychologist, he screwed it up. In which case, well, hmmm, well, I am just confused now...

Research Digest said...

People who report high levels of trust report low levels of paranoia across the board? You don't say.

Research Digest said...

I hope you're not making that judgment based on the above list of studies, which is clearly labelled as a set of controversial studies. "Selection bias" would be one of those things they teach us psychologists ;) But seriously, I have a PhD in psychology and throughout my education took 9 semesters of stats and methods. If you have any evidence that stats knowledge is better in the natural sciences than in psychology I'd like to see it.

Research Digest said...

You left out a major one! John Money's John/Jane study! Which resulted in the early deaths of both Reimer twins and resulted in numbers of children born with "ambiguous genetalia" to be mutilated.

Research Digest said...

By the way all theese expreriments and more intersting issues were described in the book "you are not so smart"

Research Digest said...

What about the bobo dolls experiment!

Research Digest said...

Do you have a reference for the "John/Jane" study?

Research Digest said...

The Daryl Bem Precognition Study interests me because of the different ways it could be interpreted without using 'precognition'. For example, it would be possible to use the Jungian concept of 'Synchronicity' to explain the findings. For those unaware of it 'Synchronicity' is defined as an 'acausal connective principle' where chance happenings have meaning for the observer as a result of unconscious mental processes.

Research Digest said...

Poverty, surely, creates uncertainty about ones future and a sense of fundamental ontological insecurity that is likely to lead to agitated forms of depression etc.especially in countries where 'happiness and security' are repeatedly tied to wealth through media representation and governmental messages about 'status' in relation to wealth. If one cannot envisage a 'safe' future because the assets to secure it are unavailable or out of reach or where one is constantly reminded that being poor makes you a 'bad' person in a 'go-getting' society it is unsurprising that it would affect mental health .

The lack of mental health problems in sections of such populations could could be seen as due to mitigating factors against these basic truths. If there is a sense of community and 'all in it together' the isolation of poverty is presumably reduced.

Several studies have been conducted on lack of basic ontological security in 'tenants' as opposed to 'home owners' for instance.

Emphasising the 'psychological' in this issue misses the real solution - that if people are removed from poverty they will feel safer and less paranoid and depressed. This is a political and social problem.

As someone who lives with this situation due to disability I am all to well aware of the impact of the media messages bout those on benefits for example. My self-esteem has been destroyed by constantly being negatively labelled and at times it has made me feel suicidal. It takes much effort to retain ones sense of self worth under such a bombardment.

Research Digest said...

I agree that the real, the fundamental, solutions to the vast majority of problems are political, social, structural, economic rather than psychological. You can't think yourself into a job through positive thinking, and you can't simply decide not to have had a childhood of abuse and neglect through the force of will.
So I agree; real, fundamental, change - real promotion of genuine mental health and well-being - requires societal change. I should say that, in my book, I make this point as clearly as I can.
However, as well as playing my full part in civil society, and voting, I am also a clinical psychologist. And, in that role, I do believe that how we have learned to make sense of the world (a consequence, absolutely, of the circumstances to which we have been exposed) makes a difference. I do feel that it's appropriate not only to change such circumstances but also, when people have been affected by them, to address the psychological consequences.

Research Digest said...

I've got my ma in physics, and my phd in cognitive psychology. Knowledge of stats is definitely much much better in cognitive psychology.

Research Digest said...

The John/Jane is actually called Bruce/Brenda. The case study about gender neutrality can be found on Google scholar by searching Money, 1974.

Research Digest said...

A nice list. As someone who found The Nurture Assumption persuasive, I'd like to have seen a link or two to more scholarly discussion of the arguments, rather than just a Newsweek article.

Research Digest said...

Being mentally well is more like the the truths which are the base of a healthy life.For that many things plays an important role especially when somebody stays loyal with the factors that are good enough it all can work appropriately is a perfect source for me that goes goodly with staying fit and healthy life you have mention.

Research Digest said...

Everyone studying or dealing with psychology is aware that 1) it is relatively a young science and that we have yet to travel a long distance over a period of few centuries in this field to acquire some substantial,valid and significant knowledge base. 2) Human nature(mind/brain) is the most complicated,vast or unlimited ocean. So far we are able to know a fraction of it. Nothing in this entire Universe(so far known) is as complicated as human nature/mind. 3) Human mind or intelligence is the most unstable entity or chemical state and it is very very sensitive to any physical and/or chemical and/or radio active rays or substances or to any social, cultural or spiritual stimuli. 4) Human life exists in two mutually complimentary dimensions namely:physical existence and emotional/spiritual existence. Therefore, the developments or findings in this field need to be viewed/considered/understood comprehensively in light of these aspects. .....G.D.Kokani.

Research Digest said...

Why no Harry Harlow?

Research Digest said...

I'm very surprised that Alfred Kinsey's study on children's sexual response and reaction time wasn't on the list! He continuously cooperated with an offending pedophile in order to collect data from him.

Research Digest said...

No, psychologists are very knowledgeable about a range of tools to apply, but are naive compared to physicists and especially mathematicians regarding the origins and fundamental assumptions underlying these tools. The reliance on p-values is a good example of how poorly many psychologists understand statistical theory.

Research Digest said...

Such a informative article for knowing the mental health problems which is associated with some people not others and finally knew the reason why it's happening with few people. So very understandable about entire things and I am sure that more information will come soon. Thanks

Research Digest said...

Hard to know why 8 - 'The Kirsch Anti-Depressant Placebo Effect Study' is considered controversial when there's a growing number of papers to show that the placebo effect accounts for most of the apparent effectiveness of all antidepressant therapies - whether these be behavioral or drug based

The important thing is to recognise that 'placebo effect' is not the same as saying 'doesn't have an effect' - as all interventions, whatever their nature, including sugar pills etc, will produce improvements in about 40% of patients compared to doing nothing.


40% is however the best we can currently hope for which means that the current funding vacuum for basic research into depression or even the development of new drug based antidepressant therapies is having a real cost in terms of quality of life and lives lost.

Research Digest said...

I appreciate reading through and next the write-up as i obtain them particularly useful and exciting. This particular write-up will be similarly useful together with exciting. Thanks for details an individual recently been sporting doing your web site such an exciting.Health and Tips

Post a Comment

Note: only a member of this blog may post a comment.