Increasing Rigour in Online Health Surveys Through the Reduction of Fraudulent Data.

Abstract

Abstract

Online surveys have become a key tool of modern health research, offering a fast, cost-effective, and convenient means of data collection. It enables researchers to access diverse populations, such as those underrepresented in traditional studies, and facilitates the collection of stigmatized or sensitive behaviours through greater anonymity. However, the ease of participation also introduces significant challenges, particularly around data integrity and rigour. As fraudulent responses - whether from bots, repeat responders, or individuals misrepresenting themselves - become more sophisticated and pervasive, ensuring the rigour of online surveys has never been more crucial. This article provides a comprehensive synthesis of practical strategies that help to increase the rigour of online surveys through the detection and removal of fraudulent data. Drawing on recent literature and case studies, we outline several options that address the full research cycle from pre-data collection strategies to post-data collection validation. We emphasize the integration of automated screening techniques (e.g. CAPTCHAs, honeypot questions) and attention checks (e.g. trap questions) for purposeful survey design. Robust recruitment procedures (e.g. concealed eligibility criteria, two-stage screening) and a proper incentive or compensation structure can also help to deter fraudulent participation. We examine the merits and limitations of different sampling methodologies, including river sampling, online panels, and crowdsourcing platforms, offering guidance on how to select samples based on specific research objectives. Post-data collection, we discuss meta-data based techniques to detect fraudulent data (e.g. duplicate email or IP addresses, response time analysis), alongside methods to better screen for low quality responses (e.g. inconsistent response patterns, improbable qualitative responses). The escalating sophistication of fraud tactics, particularly with the growth of Artificial Intelligence, demands that researchers continuously adapt and stay vigilant. We propose the use of dynamic protocols, combining multiple strategies into a multi-pronged approach that can better filter for fraudulent data and evolve depending on the type of responses received across the data-collection process. However, there is still significant room for strategies to develop, and it should be a key focus for upcoming research. As online surveys become increasingly integral to health research, investing in robust strategies to screen for fraudulent data and increasing the rigour of studies is key to upholding scientific integrity.