Value Function Based DC Algorithm for Bilevel Hyperparameter Selection Problems
-
Speaker: Haian Yin (SUSTech)
-
Time: Feb 13, 2023, 13:50-14:30
-
Location: M616, College of Science Bldg.
Abstract: Hyperparameter selection problem is inherently a bilevel optimization task. Gradient-based methods guarantee theoretical convergence to stationary solutions when for fixed upper-level variable values, the lower level of the bilevel program is strongly convex (LLSC) and smooth (LLS). In this talk, we present a sequentially convergent Value Function based Difference-of-Convex Algorithm with inexactness (VF-iDCA). We show that this algorithm achieves stationary solutions without LLSC and LLS assumptions for bilevel programs from a broad class of hyperparameter tuning applications.
