Can machine learning improve randomized clinical trial analysis

Abstract Purpose Recently a realistic simulator of patient seizure diaries was developed that can reproduce effects seen in randomized clinical trials (RCTs). RCTs suffer from high costs and statistical inefficiencies. Using realistic simulation and machine learning this study aimed to identify a more statistically efficient outcome metric. Methods Five candidate deep learning architectures with 54 permutations of hyperparameters were compared to the traditional standard, median percent change (MPC). Each were also tested for type 1 error. All models had similar outcomes, with appropriate low levels of type 1 error. Results The simplest model was equivalent to a logistic regression of a histogram of individual percentage changes in seizure rate, requiring 21-22% less patients to discriminate drug from placebo at 90% power. This model was referred to as LPC. Conclusion Future studies to validate LPC may enable faster, cheaper and more efficient clinical trials.