论文标题
t挑战:通过众包预测未来数据的准确性阿尔茨海默氏病预测
TADPOLE Challenge: Accurate Alzheimer's disease prediction through crowdsourced forecasting of future data
论文作者
论文摘要
t挑战比较算法在预测有阿尔茨海默氏病风险的个人进化方面的表现。 Tadpole挑战参与者培训了他们的模型和算法,该研究来自阿尔茨海默氏病神经影像学计划(ADNI)研究。然后,要求参与者对ADNI-3转盘参与者的三个关键结果进行预测:临床诊断,ADAS-COG 13和心室的总体积 - 然后将其与将来的测量值进行比较。挑战的重点是,预测时不存在测试数据(后来被收购),并且通过识别快速的进步者,它专注于临床试验的挑战性问题。 Tadpole的提交阶段开放至2017年11月15日;从那时起,数据已收购至2019年4月,从219名具有223次临床访问和150次磁共振成像(MRI)扫描的受试者获得,用于评估参与者的预测。三十三个团队共有92次提交。没有一个提交最好的提交来预测所有三个结果。为了诊断预测,基于梯度提升的最佳预测(团队)在接收器操作曲线(MAUC)下获得了一个多类区域,而对于心室预测,最佳预测(EMC1)是基于疾病模型和次线回归的最佳预测(Team EMC1)的平均值(均为0.41的绝对体积)(ICTARCE ICTART)。对于ADAS-COG 13,没有预测比在提交截止日期之前向参与者提供的基准混合效应模型(基准)更好。进一步的分析可以帮助了解哪些输入特征和算法最适合阿尔茨海默氏病预测以及在临床试验中有助于患者分层。
The TADPOLE Challenge compares the performance of algorithms at predicting the future evolution of individuals at risk of Alzheimer's disease. TADPOLE Challenge participants train their models and algorithms on historical data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. Participants are then required to make forecasts of three key outcomes for ADNI-3 rollover participants: clinical diagnosis, ADAS-Cog 13, and total volume of the ventricles -- which are then compared with future measurements. Strong points of the challenge are that the test data did not exist at the time of forecasting (it was acquired afterwards), and that it focuses on the challenging problem of cohort selection for clinical trials by identifying fast progressors. The submission phase of TADPOLE was open until 15 November 2017; since then data has been acquired until April 2019 from 219 subjects with 223 clinical visits and 150 Magnetic Resonance Imaging (MRI) scans, which was used for the evaluation of the participants' predictions. Thirty-three teams participated with a total of 92 submissions. No single submission was best at predicting all three outcomes. For diagnosis prediction, the best forecast (team Frog), which was based on gradient boosting, obtained a multiclass area under the receiver-operating curve (MAUC) of 0.931, while for ventricle prediction the best forecast (team EMC1), which was based on disease progression modelling and spline regression, obtained mean absolute error of 0.41% of total intracranial volume (ICV). For ADAS-Cog 13, no forecast was considerably better than the benchmark mixed effects model (BenchmarkME), provided to participants before the submission deadline. Further analysis can help understand which input features and algorithms are most suitable for Alzheimer's disease prediction and for aiding patient stratification in clinical trials.