All

Value Function Based DC Algorithm for Bilevel Hyperparameter Selection Problems

  • Speaker: Haian Yin (SUSTech)

  • Time: Feb 13, 2023, 13:50-14:30

  • Location: M616, College of Science Bldg.

Abstract: Hyperparameter selection problem is inherently a bilevel optimization task. Gradient-based methods guarantee theoretical convergence to stationary solutions when for fixed upper-level variable values, the lower level of the bilevel program is strongly convex (LLSC) and smooth (LLS). In this talk, we present a sequentially convergent Value Function based Difference-of-Convex Algorithm with inexactness (VF-iDCA). We show that this algorithm achieves stationary solutions without LLSC and LLS assumptions for bilevel programs from a broad class of hyperparameter tuning applications.