Doesn't imply much to be honest, the thing that's most interesting for me in there is the training cut-off – it's good to provide an accurate date to the model so it can usefully refuse to answer questions about events beyond that point
@simonw
-
Understanding System Prompts in AI Language Models
By
–
That assumes that it knows what a system prompt is, as opposed to knowing that when people ask about system prompts the response should look something like what it output there
-
GPT-4 Level Model Makes Unusual Python Installation Error
By
–
It did just suggest I "pip install sqlite3" in a Python prompt I ran through it though, which is a new mistake that I've not actually seen from other GPT-4 level models
-
Should We Trust What AI Models Say About Themselves?
By
–
I tend not to believe anything a model tells me about itself!
-
Extracting AI System Prompts: Challenges and Hallucination Risks
By
–
I'm not sure that's the real system prompt – looks to me like it could be a hallucination based on training data. My own attempts to extract the system prompt have so far failed:
-
AI Model Hallucination-Free Responses Challenge
By
–
I don't see any hallucinated details in here at all, which never happens with these kinds of ego-prompts for me
-
Training Data Contamination and Model Self-Knowledge Limitations
By
–
Loads of models do that, because their training data included examples of text that included ChatGPT output Directly asking a model questions about itself remains a surprisingly ineffective way of learning anything useful about the model
-
LMSYS Reputation Risk: Opaque Model Launch Concerns
By
–
Feels to me like a bit of a reputation risk to @lmsysorg though if this is indeed a stealth model launch They're supposed to be a neutral benchmarking tool, it's not a great look if they're working behind-the-scenes with model vendors in an opaque manner like this
-
New GPT2 Chatbot Impresses with Better Search Results
By
–
You can try out the mysterious gpt2-chatbot at https://
chat.lmsys.org (select "Direct Chat" and pick it from the menu) Initial impressions: I'm very impressed. It gave me a better answer for an ego search ("Who is Simon Willison?") than any other model I've tried -
Paper Shows AI Systems Lack Robust Adversarial Attack Protection
By
–
Their paper concludes with a note that this isn't a robust protection against adversarial attacks – more notes here