GENERATIVE AI

→ View original post on X — @karpathy

Future Plans for GPT-2 Implementation and Educational Content

By

@karpathy

–

11 January 2023 20h04

I'd like to continue to make it faster, reproduce the other GPT-2 models, then scale up pre-training to bigger models/datasets, then improve the docs for finetuning (the practical use case). Also working on video lecture where I will build it from scratch, hoping out in ~2 weeks.

→ View original post on X — @karpathy

nanoGPT: Simplest Repository for Training Medium-Sized GPTs

By

@karpathy

–

11 January 2023 20h04

Didn't tweet nanoGPT yet (quietly getting it to good shape) but it's trending on HN so here it is 🙂 : https://
github.com/karpathy/nanoG
PT
…
Aspires to be simplest, fastest repo for training/finetuning medium-sized GPTs. So far confirmed it reproduced GPT-2 (124M). 2 simple files of ~300 lines

ChatGPT Politeness and Data Training Practices Disagreement

By

–

11 January 2023 19h51

Fact – Saying thank you to ChatGPT improves responses later in the current chat session you're in. Fact – They have implied they are using data from the current free preview to train it to better respond in the future. I disagree with your assessment.

Bullish on Mem.ai’s Document Indexing and AI Integration

By

–

11 January 2023 19h23

. @memdotai is doing something similar with the way the AI reads and indexes all the docs in your account and can reference them when you use an AI command. It's why I'm so bullish on them as a company

Key Factors for Implementing AI Workflows and Prompt Engineering

By

–

11 January 2023 18h36

## Conclusion If you follow me and read my posts, you’re going to learn new workflows and prompt engineering strategies that will transform your business. But strive to keep these factors in mind as you implement them.

Notion AI: Power Through Seamless User Experience Integration

By

–

11 January 2023 18h36

Notion as an example: Notion’s implementation of AI is not about the prompts that power its magical results. What makes it good is the user experience of having access to all that power within a doc you’re already using.