In this section, we would like to introduce the design of differentiable cost functions for different objectives.
when the search space is too large, beam-search-based methods always fail to find the constrained optimal solution.