TY - JOUR
T1 - Clinical trial monitoring effectiveness
T2 - Remote risk-based monitoring versus on-site monitoring with 100% source data verification
AU - Yamada, Osamu
AU - Chiu, Shih Wei
AU - Takata, Munenori
AU - Abe, Michiaki
AU - Shoji, Mutsumi
AU - Kyotani, Eri
AU - Endo, Chiyo
AU - Shimada, Minami
AU - Tamura, Yuko
AU - Yamaguchi, Takuhiro
N1 - Funding Information:
We would like to thank Nippon Chemiphar Co., Ltd. for supporting the clinical trial selected for this research. We also thank Editage (www.editage.com) for English-language editing. The author(s) received no financial support for the research, authorship, and/or publication of this article.
Publisher Copyright:
© The Author(s) 2020.
PY - 2021/4
Y1 - 2021/4
N2 - Background/Aims: Traditional on-site monitoring of clinical trials via frequent site visits and 100% source data verification is cost-consuming, and it still cannot guarantee data quality effectively. Depending on the types and designs of clinical trials, an alternative would be combining several monitoring methods, such as risk-based monitoring and remote monitoring. However, there is insufficient evidence of its effectiveness. This research compared the effectiveness of risk-based monitoring with a remote monitoring system with that of traditional on-site monitoring. Methods: With a cloud-based remote monitoring system called beagle View®, we created a remote risk-based monitoring methodology that focused only on critical data and processes. We selected a randomized controlled trial conducted at Tohoku University Hospital and randomly sampled 11 subjects whose case report forms had already been reviewed by data managers. Critical data and processes were verified retrospectively by remote risk-based monitoring; later, all data and processes were confirmed by on-site monitoring. We compared the ability of remote risk-based monitoring to detect critical data and process errors with that of on-site monitoring with 100% source data verification, including an examination of clinical trial staff workload and potential cost savings. Results: Of the total data points (n = 5617), 19.7% (n = 1105, 95% confidence interval = 18.7–20.7) were identified as critical. The error rates of critical data detected by on-site monitoring, remote risk-based monitoring, and data review by data managers were 7.6% (n = 84, 95% CI = 6.2–9.3), 7.6% (n = 84, 95% confidence interval = 6.2–9.3), and 3.9% (n = 43, 95% confidence interval = 2.9–5.2), respectively. The total number of critical process errors detected by on-site monitoring was 14. Of these 14, 92.9% (n = 13, 95% confidence interval = 68.5–98.7) and 42.9% (n = 6, 95% confidence interval = 21.4–67.4) of critical process errors were detected by remote risk-based monitoring and data review by data managers, respectively. The mean time clinical trial staff spent dealing with remote risk-based monitoring was 9.9 ± 5.3 (mean ± SD) min per visit per subject. Our calculations show that remote risk-based monitoring saved between 9 and 41 on-site monitoring visits, corresponding to a cost of between US$13,500 and US$61,500 per trial site. Conclusion: Remote risk-based monitoring was able to detect critical data and process errors as well as on-site monitoring with 100% source data verification, saving travel time and monitoring costs. Remote risk-based monitoring offers an effective alternative to traditional on-site monitoring of clinical trials.
AB - Background/Aims: Traditional on-site monitoring of clinical trials via frequent site visits and 100% source data verification is cost-consuming, and it still cannot guarantee data quality effectively. Depending on the types and designs of clinical trials, an alternative would be combining several monitoring methods, such as risk-based monitoring and remote monitoring. However, there is insufficient evidence of its effectiveness. This research compared the effectiveness of risk-based monitoring with a remote monitoring system with that of traditional on-site monitoring. Methods: With a cloud-based remote monitoring system called beagle View®, we created a remote risk-based monitoring methodology that focused only on critical data and processes. We selected a randomized controlled trial conducted at Tohoku University Hospital and randomly sampled 11 subjects whose case report forms had already been reviewed by data managers. Critical data and processes were verified retrospectively by remote risk-based monitoring; later, all data and processes were confirmed by on-site monitoring. We compared the ability of remote risk-based monitoring to detect critical data and process errors with that of on-site monitoring with 100% source data verification, including an examination of clinical trial staff workload and potential cost savings. Results: Of the total data points (n = 5617), 19.7% (n = 1105, 95% confidence interval = 18.7–20.7) were identified as critical. The error rates of critical data detected by on-site monitoring, remote risk-based monitoring, and data review by data managers were 7.6% (n = 84, 95% CI = 6.2–9.3), 7.6% (n = 84, 95% confidence interval = 6.2–9.3), and 3.9% (n = 43, 95% confidence interval = 2.9–5.2), respectively. The total number of critical process errors detected by on-site monitoring was 14. Of these 14, 92.9% (n = 13, 95% confidence interval = 68.5–98.7) and 42.9% (n = 6, 95% confidence interval = 21.4–67.4) of critical process errors were detected by remote risk-based monitoring and data review by data managers, respectively. The mean time clinical trial staff spent dealing with remote risk-based monitoring was 9.9 ± 5.3 (mean ± SD) min per visit per subject. Our calculations show that remote risk-based monitoring saved between 9 and 41 on-site monitoring visits, corresponding to a cost of between US$13,500 and US$61,500 per trial site. Conclusion: Remote risk-based monitoring was able to detect critical data and process errors as well as on-site monitoring with 100% source data verification, saving travel time and monitoring costs. Remote risk-based monitoring offers an effective alternative to traditional on-site monitoring of clinical trials.
KW - Remote monitoring
KW - clinical trial monitoring
KW - risk-based monitoring
UR - http://www.scopus.com/inward/record.url?scp=85097074221&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85097074221&partnerID=8YFLogxK
U2 - 10.1177/1740774520971254
DO - 10.1177/1740774520971254
M3 - Article
C2 - 33258688
AN - SCOPUS:85097074221
SN - 1740-7745
VL - 18
SP - 158
EP - 167
JO - Clinical Trials
JF - Clinical Trials
IS - 2
ER -