What is a model hallucination? Model hallucinations are when you ask a factual question, like "how many dogs are in the state of Illinois in the United States?", and the model generates something that appears to be a potentially valid answer but is entirely made up.
@whats_ai
-
Understanding Prompts: Text Input for AI Models
By
–
What is a prompt? Prompts are just text that you send to the model.
And it can be something as simple as a question or a statement or a command, but it can also be super intricate, like a multi-paragraph or a 20 (n) step process. It's essentially what you want the model to do. -
What is Prompt Engineering: Iterative Refinement Process
By
–
What is a prompt engineer? Prompt engineering is the iterative process of refining the prompt to have the model do what you want. The model might not always do what you want the first time you ask. You modify your prompt and see if you can get it closer to the output you want.
-
Understanding AI Alignment: Post-Training Model Refinement
By
–
What is alignment? Alignment is a process done after training and consists of taking a base model and making it more beneficial to a human. You can go through this alignment process to make the model more in tune with what humans want to see.
-
RLHF: Aligning AI Models with Human Preferences
By
–
What is RLHF? In some sense, RLHF is part of that alignment process, where you tune the model to look at a bunch of human preferences.
You can show a bunch of example outputs and then let users, actual humans, decide what output is better for them, and you tune the model. -
Understanding Tokens: How AI Models Process Text
By
–
What is a token? Tokens are how the model understands text. Instead of understanding text at a word level or an individual character level, it understands at a token level.
-
Understanding GPT: Generative Pre-trained Transformers Architecture
By
–
What is GPT? GPT is just the architecture of the model essentially. GPT stands for Generative Pre-trained Transformers, which is the technology that GPT-4 and GPT-3.5, all those models are based on that technology.
-
ChatGPT vs GPT-4: Understanding the Difference
By
–
What is the difference between ChatGPT and GPT-4? ChatGPT is a website, a UI; it's an engineering product that is an interface for OpenAI's machine learning models, of which GPT-4 is one of them. So GPT-4, GPT-3.5… are the actual machine learning models used in ChatGPT.
-
OpenAI GPT Dictionary: Essential Generative AI Vocabulary Terms
By
–
OpenAI & GPT Dictionary of Vocabulary. Generative AI Terms To Know In 2023 #ai #gpt #chatgpt #openai
-
AI Hallucinations and Explainability in Artificial Intelligence Ethics
By
–
In this week's iteration, we are tackling AI Hallucinations! An introduction to Explainability in AI (XAI) and a dive into the topic of AI ethics and talking about why explainability is such a crucial aspect… Read more: https://
louisbouchard.substack.com/p/260f2cc4-c7d
3-4def-8c3e-82673cec7789
…