Hey Siri, please stop using your Artificial Intelligence for a moment – our weekly recap – Innovation Origins Read more here: https://
ift.tt/lAfa64c #ArtificialIntelligence #AI #DataScience #100DaysOfCode #Python #MachineLearning #BigData #DeepLearning #NLP #Robots #IoT
LLMS
-
Weekly AI Innovation Recap: Machine Learning and Deep Learning Updates
By
–
-
ChatGPT likely derived from Codex via text-davinci-002 model lineage
By
–
ChatGPT’s model is likely descended from Codex. Models are developed off of other models. The model ChatGPT uses was probably based on another model called text‑davinci‑002, which is based on code‑davinci‑002, a Codex model. So it was trained on code at one point.
-
ChatGPT programmers lack epistemics and advance predictions
By
–
By default, I would guess that if the people programming ChatGPT responses do not even think to ask 'But is that actually true?', then the company does not have a secret internal committee where everyone has great epistemics and wrote down advance predictions.
-
GPT-3.5 Could Lower Status of Bullshit and AI-Like Speech
By
–
It's more of a hope than a prediction: but I would not be *shocked* if GPT 3.5's incredible facility at producing boilerplate, vague disclaimers, unfalsifiable abstractions, etc, might actually succeed in lowering the status of bullshit, and getting people to talk less like AIs.
-
ChatGPT’s Vague Claims About Its Own Capabilities
By
–
Sounds pretty vague to me; I think you're reading in the interpretation you now know to be correct. Example of contrary update (for me): ChatGPT insists it doesn't have abilities it clearly still has. I'd bet the people who burned in those replies weren't knowingly dishonest.
-
ChatGPT pretends to have code but fails scrutiny
By
–
ChatGPT is capable writing working code in other contexts, for simple problems, but this isn’t that. This is pretending that some larger body of code exists, and then talking about it and showing plausible-seeming pieces of it. It wouldn’t stand up to serious scrutiny.
-
ChatGPT Technical Details Related to InstructGPT Research
By
–
relatively few technical details have been released so far, but chatgpt is related to instructgpt https://
arxiv.org/abs/2203.02155 -
Improve GPT-3 regex output by rewriting with comments
By
–
It’s also not a new breakthrough — here’s an example of mine from August using GPT-3. The trick to good output on these is to make it first rewrite the regex on multiple lines with comments, then analyze its high-level purpose afterward. Avoids hallucination.
