Validation of Dynamic Bayesian Optimization for Human-in-the-Loop Optimization of Exoskeleton Control at User-Driven Walking Speed

Human-in-the-loop optimization (HILO) is an established method for identifying subject-specific optimal controllers for performance augmentation. For HILO algorithms to be useful in rehabilitation, however, the optimization algorithm may need to account for how the human response changes over time in response to assistance. In this study, we tested a modified version of Bayesian optimization (BO), dynamic Bayesian optimization (DBO), in a three-parameter optimization problem that sought to identify participant-specific optimal solutions for increasing walking speed. As opposed to BO, DBO accounts for the non-stationarity of human responses. Sixteen healthy participants received bilateral hip torque pulses delivered by a hip exoskeleton. The exoskeleton torque parameters were determined using HILO with either DBO or BO. Validation iterations were introduced to objectively compare performance across optimizers at different time points of HILO. The results showed that both DBO and BO significantly increased walking speed compared to baseline. When comparing performance between DBO and BO, DBO emerged as an improvement over BO both in terms of efficacy, modeling accuracy, and personalization. DBO induced changes in walking speed relative to baseline that exceeded those induced by BO at three of the four validation iterations. DBO outperformed BO in modeling accuracy in later validation iterations. DBO personalization induced changes in walking speed that were significantly greater than those induced by previously identified assistive solutions, while this was not the case of BO. Overall, our results indicate that DBO outperformed BO due to its greater ability to account for non-stationary aspects of the human response.