CODE

Daily Python Machine Learning and Language Models Content Sharing

By

–

04 March 2023 14h51

That's a wrap. Every day, I share and simplify complex concepts around Python, Machine Learning & Language Models. Follow me → @Sumanth_077 if you haven't already to ensure you don't miss that. Like/RT the first tweet to support my work and help this reach more people.

RLHF Resources: OpenAI and Hugging Face Learning Materials

By

–

04 March 2023 14h51

Here are some resources which you can further research on RLHF: Open AI's blog: http://
openai.com/blog/instructi
on-following/
…… Hugging Face blog: https://
huggingface.co/blog/rlhf

SFT Model Training with Reward Function Iterations

By

–

04 March 2023 14h51

Step3: Sample a Prompt from the dataset, give that to the SFT model and get the generated response. Use the RF model to calculate the reward of the response and use that to update the Model. Iterate over it. That's how they have developed it. 9/9

Using Reward Models and PPO to Fine-tune Language Models

By

–

04 March 2023 14h51

Now we don't need Humans to rank the responses. We have RM which will take care of that. The final step is to use this RM as a reward function and fine-tune the SFT model to maximize the reward using Proximal Policy Optimization which is Reinforcement Learning Algorithm 8/9

Supervised Fine-Tuning GPT-3.5 with Human-Written Answers

By

–

04 March 2023 14h51

Step1: They have prepared a dataset of human-written answers to the prompts and used that to train the model which is called Supervised Fine-Tuning (SFT) model. The model used here for fine-tuning is the Instruct GPT(GPT-3.5) 5/9

Fine-tuning GPT-3 with RLHF to Create InstructGPT

By

–

04 March 2023 14h51

So fine-tuning the GPT-3 model using the RLHF method(which we will look at later) results in Instruct GPT. Instruct GPT is much better at following instructions than GPT-3 Compare the example below on how GPT3 & InstructGPT answer a question. 2/9

→ View original post on X — @yuhelenyu

NewSQL Databases: CockroachDB, TiDB, MemSQL, NuoDB

By

@yuhelenyu

–

04 March 2023 4h13

NewSQL databases include CockroachDB, TiDB, MemSQL, and NuoDB.

→ View original post on X — @karpathy

Python and English Code: Mixing Scripts with GPT API Prompts

By

@karpathy

–

04 March 2023 1h21

A file I wrote today is 80% Python and 20% English. I don't mean comments – the script intersperses python code with "prompt code" calls to GPT API. Still haven't quite gotten over how funny that looks.