COMAL: A Convergent Meta-Algorithm for Aligning LLMs with General Preferences

Yixin Liu, Argyris Oikonomou, Weiqiang Zheng, Yang Cai, Arman Cohan
January 2026
arxiv
Type
Conference paper
Publication
The 14th International Conference on Learning Representations (ICLR)
AI Alignment NLHF RLHF last-iterate convergence
Yang Cai
Yang Cai
Professor

Related