Faking Effects on Situational Judgement Tests like CASPer™

MYTH:  “Faking your answers for Situational Judgement Tests like CASPer™ is highly unlikely/impossible.”

FACT:  The current literature shows that individuals can fake their responses on SJTs.  According to Whetzel and McDaniel (2009), faking on a selection measure refers to deliberate distortion of responses by individuals in order to score favorably. There has been debate as to whether people can fake on selection measures, and what impact it has.  Whetzel and McDaniel (2009) stated that the research on faking clearly shows that people can fake on SJTs. Faking therefore, can be considered to be one of the documented weaknesses of using SJTs to predict performance.  Nguyen et al. found that SJTs presented under a behavioral tendency response format (ie. CASPer™) could be faked, with effect sizes ranging between .15 and .34 (15%-34%).

The take home message for applicants required to take SJTs like CASPer™ is to be informed and prepared for your test.

References:

Whetzel, D. L., & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review, 19, 188-202.

Nguyen, N. T., Biderman, M. D., & McDaniel, M. A. (2005). Effects of response instructions on faking a situational judgment test. International Journal of Selection and Assessment, 13, 250-260.

Coaching & Practice Effects on Situational Judgement Tests like CASPer™

MYTH:  “Situational Judgement Tests like CASPer™ are immune to test preparation (ie. coaching is unlikely to provide benefit.”

FACT:  Once again, the current literature review shows that individuals do benefit from test preparation (even for SJTs). One study by Cullen, Sackett and Lievens (2006) examined the coachability of SJTs for consideration as selection instruments in high-stakes testing. Cullen et al. concluded that performance on some SJTs could be enhanced by coaching.  In terms of practice effects, Cullen et al. indicated that the retest effects of SJTs are not larger than effects for traditional tests such as cognitive ability tests.

The take home message for applicants required to take SJTs like CASPer™ is to be critical and take advantage of resources within their means to optimize their test performance just as they would for other standardized tests such as the MCAT.

References:

Cullen, M.J., Sackett, P.R., & Lievens, F. (2006). Threats to the operational use of situational judgment tests in the college admission process. International Journal of Selection and Assessment, 14, 142-55.

Ebo K. A Osam (2014) The Adaptation of a Situational Judgement Test to Measure Leadership Knowledge in the Workplace, Western Kentucky University