Hauch, V., Sporer, S. L., Masip, J., & Blandón-Gitlin, I. (2017). Can credibility criteria be assessed reliably? A meta-analysis of Criteria-based Content Analysis. Psychological Assessment, 29, 819-834. doi:10.1037/pas0000426
Can verbal content cues regarding the veracity of a statement be coded reliably with an approach called Criteria-Based Content Analysis (CBCA)? We used meta-analysis, a statistical method for summarizing large numbers of studies to address this question. CBCA is an important component of Statement Validity Assessment (SVA), a forensic procedure used in many countries to evaluate whether statements (e.g., of sexual abuse) are based on experienced or fabricated events. CBCA contains 19 verbal content criteria, which are frequently adapted for research on detecting deception. A total of k = 82 hypothesis tests revealed acceptable interrater reliabilities for most CBCA criteria, as measured with various indices (except Cohen’s kappa). However, results were largely heterogeneous, necessitating moderator analyses. Blocking analyses and meta-regression analyses on Pearson’s r resulted in significant moderators for research paradigm, intensity of rater training, type of rating scale used, and the frequency of occurrence (base rates) for some CBCA criteria. The use of CBCA summary scores is discouraged. Given worldwide popularity of CBCA in the evaluation of sexual abuse and other forensic applications, its reliability is of utmost importance. Implications for research vs. field settings, for future research and for forensic practice in the United States and Europe are discussed.
http://psycnet.apa.org/doiLanding?doi=10.1037%2Fpas0000426
Comments are closed.