A survey on high-dimensional Gaussian process modeling with application to Bayesian optimization

Extending the efficiency of Bayesian optimization (BO) to larger number of parameters has received a lot of attention over the years. Even more so has Gaussian process regression modeling in such contexts, on which most BO methods are based. A variety of structural assumptions have been tested to tame high dimension, ranging from variable selection and additive decomposition to low dimensional embeddings and beyond. Most of these approaches in turn require modifications of the acquisition function optimization strategy as well. Here we review the defining assumptions, and discuss the benefits and drawbacks of these approaches in practice.