Friday, 9 January 2015

One in ten student research participants don't make an effort

It's near the end of your university semester, you're tired and now you've got to sit through 90 minutes of monotonous psychology tests to fulfil the requirements for your course. This is a familiar situation for psychology undergrads, many of whom form the sample pools for thousands of psychology studies.

Concerns have been raised before that psychology findings are being skewed by the (lack of) effort students put into their performance as research participants. Last year, for example, researchers found that students who volunteer near the end of term perform worse on psychology tests than those who volunteer earlier.

Now Jonathan DeRight and Randall Jorgensen at Syracuse University have investigated student effort in 90 minutes of computerised neuropsychology tests designed to measure attention, memory, verbal ability and more. The session, which took place either during a morning or afternoon late in the Spring semester, involved the students taking the same broad battery of tests twice, with a short gap in between. The students received course credits for their time.

To test whether the students were making a proper effort, the researchers embedded several measures - for example, performing worse than chance on a multiple-choice style verbal memory challenge was taken as a sign of low effort; so was performing more slowly on an easier version of a mental control task than on the more difficult version.

Among the 77 healthy student participants who took part (average age 19; 36 women), the researchers identified 12 per cent who failed at least one of the embedded measures of effort during the first battery of neuropsych tests; 11 per cent also failed one or more measures during the second battery. The vast majority of those who showed low effort had participated in the morning. In fact, focusing only on the morning participants, one in four displayed low effort.

Unsurprisingly, low effort also went hand in hand with poorer performance on the neuropsych tests, especially one of the longest and most dull cognitive tests (the "continuous performance task"), and especially during the second battery. A consistent exception was a particularly complex version of a test of mental self-control (the Stroop task) - perhaps because the challenge of the task provoked more concentration, even from students who were mostly not trying hard.

The estimate from this study of the fraction of student research participants not making an effort are consistent with some prior studies, but not others (the latter research found less evidence of poor effort). Clearly more research is needed. DeRight and Jorgensen concluded that "healthy non-clinical samples cannot necessarily be assumed to have put forth adequate effort or valid responding." They added: "Assessing for effort in this population is imperative, especially when the study is designed to provide meaningful results to be used in clinical practice." This last, important point is a reference to the fact that results from students are often used to establish estimates of "normal" performance on neuropsychology tests, for comparison when investigating patients with brain damage or other problems.


DeRight, J., & Jorgensen, R. (2014). I Just Want My Research Credit: Frequency of Suboptimal Effort in a Non-Clinical Healthy Undergraduate Sample The Clinical Neuropsychologist, 1-17 DOI: 10.1080/13854046.2014.989267

--further reading from The Psychologist--
Improving the student participant experience
The use and abuse of student participants

Post written by Christian Jarrett (@psych_writer) for the BPS Research Digest.


Research Digest said...

They both are trying to be cool to each other in that situation. So, none of them will show moral differences...

Research Digest said...

A concerning topic indeed. I suppose it begs the question of whether non-students who participate due to some extrinsic motivation (e.g. monetary reward/shop vouchers) have display a similar lack of effort. The problem is that without some kind of "payback" for those do make an effort it can be difficult to recruit enough people for a well-powered study...perhaps the best approach is to give some kind of payback, but monitor for those who are not making an effort on the tasks and exclude them?

Another issue to consider is that of demand characteristics; if psychology students in particular are more aware of psychological research and theory, they may be more capable of "giving researchers what they want".

Research Digest said...

I have long heard of the claim you cannot tickle yourself and have always been puzzled. I have Aspergers. (HFA) I can tickle my self anywhere with a light touch or with a feather, that is enjoyable but have to stop sometimes because it is excruciating ticklish. I have never been diagnosed with Schizophrenia. I am very sensitive to sensory stimuli, touch, sound, smell, light, color. Do you think my heightened sensory receptors could also play a part? Have you done any tests on people on the autism spectrum?

Research Digest said...

I can`t stop thanking DR Orissa for this Great thing he has done in my life, I am so grateful to him, i was suffering from HIV virus for 9years, after reading the wonderful testimony that people has been sharing about him.i have being on medication and trying looking for cure to my ailment. I went through internet doctors and i contacted a Tradomedical/Traditional doctor named, Dr.Orissa for help. He give me all his rules and regulations,that if he cured me that I should write about him on internet site and i agreed that is what I`m doing now. He assure me that he will cure me with his herbal medicine which he really did, and I`m now completely cured from HIV virus. What will i say rather than thanking him for saving my life. Why suffering in silence when there is remedy to your diseases.Dr Orissa also specialize in curing the following disease: *HIV/Aids *Kidney failure *Arthritis *Diabetes *Hypertension *Stroke *Obesity *Infertility/Impotency *Cancer *Eye Problem *Skin Problem *Fibroid Tumor *Ulcer *Prostate Problem *Asthma *Weight Management*Staphylococcus *Candidie *Low sperm can *Weak erection *Weak ejaculation *Pile *Elephantiasis *Skin Infection *Paralysis. your can contact him via email;

Post a Comment

Note: only a member of this blog may post a comment.