Hello @gdb is openAI now a full business company by forgetting all the fundamental researches and no more collaborating with the « Open AI Community » ? What’s the balance between the two fields please ?
RESEARCH
-
Reward Modeling Secrets in RLHF for Large Language Models
By
–
Secrets of RLHF in Large Language Models Part II: Reward Modeling Wang et al.: https://
arxiv.org/abs/2401.06080 #LLM #RLHF #ReinforcementLearning -
DPO Implementation in BTLM-3B Chat Model
By
–
Couldn't agree more! We implemented DPO in our BTLM-3B chat model
-
OpenAI Tokenizer: Understanding Token-Logprob Key-Value Pairs
By
–
not sure what your first question means, but in this case we rely on knowing the tokens of the tokenizer; openAI gives us back key-value pairs of token-logprob
-
LLMs Predict Human Behavior Complexity for Policy Research
By
–
Can large language models predict the complexity of human behavior in experiments? An interdisciplinary team seeks to push the boundaries of AI to help social scientists identify effective policy or public health interventions. https://
stanford.io/3HdVf11 -
Supervised Fine-Tuning and Prompt Engineering as Forms of AI Model Alignment
By
–
Yes. Arguably supervised fine-tuning and even prompt engineering are forms of model alignment even if nobody calls them that.
-
Why AI Researchers Should Write Unit Tests for Code
By
–
As an AI researcher there are many good reasons to write unit tests for your code, but perhaps the best motivator to write tests is the respect (and often surprise) from other people when they look at your code and see you actually wrote unit tests.
-
AI Alignment and Instruction Tuning Discussed in InstructGPT Context
By
–
The sense used in the InstructGPT paper is good — a model is aligned when it does what its designers want. Instruction tuning is the canonical form of LLM alignment, but earlier methods like filtering pre-train data of undesired content count too.
-
Inverting Prompts, Training Data Detection, and Distillation Techniques
By
–
– inverting prompts from logits
– training data detection (
@WeijiaShi2 worked on this)
– distillation