Paying participants: The impact of compensation on data quality
Date
2022-12
Authors
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Cises Srl
Abstract
Poor-quality data has the potential to increase error variance, reduce statistical power and effect sizes, and produce Type I or Type II errors. Paying participants is one technique researchers may use in an attempt to obtain high-quality data. Accordingly, two secondary datasets were used to examine the relationship between participant payment and data quality. The first dataset revealed that data quality did not differ between paid and unpaid undergraduates. Similarly, the second dataset showed that data quality did not differ between unpaid community participants and MTurkers. A comparison across stud-ies showed that undergraduate students engaged in lower levels of careless responding than the commu-nity samples but the unpaid community sample outperformed the MTurk sample and both undergraduate samples. Taken together, the current findings suggest that offering financial incentives to undergraduate or community samples does not improve data quality but may improve data collection rates and increase the diversity of participants.
Series Number
Journal Issue
Is Version Of
Versions
Series
Academic or Administrative Unit
Type
article
Comments
More, K. R., Burd, K. A., More, C., & Phillips, L. A., Paying participants: The impact of compensation on data quality. Testing, Psychometrics, Methodology in Applied Psychology, December 2022 29(4);403-417; doi:10.4473/TPM29.4.1
© 2022 Cises Green Open Access under CC BY-NC-ND 4.0 International License©
© 2022 Cises Green Open Access under CC BY-NC-ND 4.0 International License©