#direct-nash-optimization

#direct-nash-optimization

The extension of the Direct Nash Optimization (DNO) framework includes handling regularized preferences, distinguishing it from Nash-MD by utilizing smoothed policies for better guarantees.

This paper introduces Direct Nash Optimization (DNO), a novel approach that integrates stability and generality in large language model post-training, moving beyond traditional reward maximization limits.