Open Instruct: A Simple Method for Aligning Language Models with Human Preferences

Machine learning scientist at Ai2 working on reinforcement learning, language models, and online social systems.

Saumya Malik is an incoming postdoctoral scholar at Johns Hopkins University and recently completed a PhD in the Machine Learning Department at Carnegie Mellon University. Her interests include interpretability, evaluation, reward learning, and language model agents.

Noah A. Smith is a computer scientist and professor at the University of Washington, where he serves as Vice Provost for Artificial Intelligence and co-directs the OLMo open language modeling effort with Ai2. His research focuses on natural language processing, machine learning, and evaluation methodology.

Yizhong Wang is a research scientist at the Allen Institute for AI and incoming assistant professor at the University of Washington whose work focuses on language models, agents, reasoning, and open-source AI.

Senior research scientist at Ai2 and associate professor at Yale working on long-form language understanding, information retrieval, and scientific NLP.

Machine learning engineer at Ai2 whose public work focuses on open language models, post-training, and evaluation.

Alexandre Ramé is a research scientist at Google DeepMind and an adjunct professor at Ecole Polytechnique. His homepage says he previously held research roles at NYU and SCAI / Sorbonne Université, completed a PhD in machine learning at Ecole Polytechnique and ENS Paris-Saclay, and works on post-training and alignment for Gemma LLMs.

Public report authorship links Tianyi Zhang to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Public report authorship links Osama Ramadan to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Public report authorship links Jason Wu to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Public report authorship links Nino Vieillard to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Research engineer at Ai2 working on open language models, machine learning systems, and evaluation.

Public report authorship links Thomas Scialom to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Allen Institute for AI researcher working on NLP, machine learning, and AI, and a co-author of Open Instruct.

Public report authorship links Tim Dodds to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

AI2 researcher working on multimodal language models, evaluations, instruction tuning, and preference alignment, and a co-author of Open Instruct.

Public report authorship links Andrew Drozdov to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Public report authorship links Yann Dubois to the Open Instruct: A Simple Method for Aligning Language Models with Human Preferences at Ai2.

Research scientist at the Allen Institute for AI focused on training, evaluating, and interpreting language models, with work spanning NLP and computational social science.

Canonical link

Nathan Lambert

Saumya Malik

Noah A. Smith

Yizhong Wang

Arman Cohan

Nicholas Ruas

Alexandre Ramé

Tianyi Zhang

Osama Ramadan

Jason Wu

Nino Vieillard

Karishma Prasad

Thomas Scialom

Hailey Schoelkopf

Tim Dodds

Cyrus Hessel

Andrew Drozdov

Yann Dubois

Shuyan Zhou