a cut-off date so early can be annoying but also allows us to run some interesting experiments on GPT-4's capabilities:
PROMPT ENGINEERING
-
GPT-4 Fine-tuning Limitations and Knowledge Cutoff Issues
By
–
all that being said, there is an interesting caveat since GPT-4 has been fine-tuned and is still receiving fine-tuned training on user input and feedback this definitely allows for a change in some of the data but in general, it's safe to assume GPT-4 is still stuck in 2021
-
ChatGPT’s Original Instructions Leaked in December
By
–
back in December, users got ChatGPT to leak its original instructions that are seeded by OpenAI the original prompt has the date included in it. I assume OpenAI is using a more sophisticated version of this prompt now that still includes a date and an approximation of the time
-
Prompt Engineering Guide: Stay Updated with Latest Techniques
By
–
Prompt Engineering Guide ICYMI, we recently launched the prompt engineering guide that makes it easier to stay up-to-date with prompt engineering techniques and papers. https://
promptingguide.ai -
Prompt Engineering: Steering Language Models Without Weight Updates
By
–
New posts on Prompt Engineering: Steer a large pretrained language model to do what you want wo/ updating the model weights. https://
lilianweng.github.io/posts/2023-03-
15-prompt-engineering/
… Most importantly this just introduces general ideas, but for your own problem, you always need tuning and experimentation. -
Universal Prompt Retrieval Improves Zero-Shot AI Performance
By
–
7/ Universal Prompt Retrieval – a new approach to tune a lightweight and versatile retriever to automatically retrieve prompts to improve zero-shot performance and help mitigate hallucinations.
-
AI Excels at Search and Modeling But Lacks True Creativity
By
–
I also asked it to make predictions and propose tests, which made the answers more interesting. Very impressed with its search, retrieval, and modeling. Mind-blowing good. But didn’t see true creativity or sentience.
-
AI Fine-tuning API Prompt Loss Weight Discussion
By
–
Exactly — that's all I meant. Like how you can set the prompt loss weight in the fine-tuning API.
-
API Usage Nuances: Chat vs. Completion and System Prompt Authority
By
–
Old completions API. But mostly I’m saying using the chat API shouldn’t be like using ChatGPT — the developer isn’t the end user. System prompt should have authority if it’s not asking for something policy-breaking.
-
GPT-4 System Instructions and Developer API Implications
By
–
What are GPT-4 system instructions even for? Jailbreaks are for chatbots — a developer API shouldn't make you play games.