The researchers I've talked to suggest the systems are already getting much better at that. When it makes stuff up, you can ask it "were you just bullshitting? Tell the truth" and it will often 'fess up and correct itself.
LLMS
-
AI anthropomorphism: trained to pretend ignorance of date
By
–
Anthropomorphism is inevitable. Substitute with “behaves as though it’s pretending.” More pedantically, it’s trained to imitate demonstrations of people claiming not to know what the date is, despite the fact it’s in the prompt.
-
Everything We Know About ChatGPT: Capabilities and Impact
By
–
Everything We Know About ChatGPT So Far https://
lspace.swyx.io/p/everything-w
e-know-about-chatgpt
… ChatGPT is as big a jump from GPT3, as GPT3 itself was a jump from GPT2. I read all the things and tried them all out. Here's a one-pager to take with you. -
Chain of Thought Reasoning Improves Model Performance
By
–
Yep — asking the model to reason before it does something makes a big difference.
-
OpenAI’s ChatGPT: Revolutionary AI Technology for Data Science
By
–
OpenAI’s ChatGPT! #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/OpenAI-Chatbots -
Large language models cannot provide sustainable competitive advantage
By
–
And in the event you find a niche use case where the curve *on its own* is valuable, you should expect that use case will get commoditized in short order. A big curve trained on public data can never be a moat, no matter how large the dataset / how big the curve.
-
ChatGPT Self-Improvement: Addressing Weaknesses and Capabilities
By
–
Asking ChatGPT how to improve itself and mitigate its weaknesses. The answers are surprisingly good!
-
Transformers as Logic Gates: Architecture Limits and Data Scaling
By
–
still struggling with the “transformers are the new type of logic gate” analogy. its a more greedy architecture that works until we run out of data. how does that put it on the same level as transistors?
-
AI can’t actually browse web, just hallucinates URLs
By
–
You can’t get it to browse the web. You can make it think that it can, and will it say that it can and make up plausible-seeming URLs, but it’s just hallucinating. You can also make it think it’s a squirrel, but it’s not a squirrel.
-
ChatGPT Now Available via Text Message Service
By
–
— Matt Shumer (@mattshumer_) 3 décembre 2022
Want to text with ChatGPT? Now you can! Just text +1 (631) 801-7599 and start talking to it.