The issue here is that the web is full of ChatGPT outputs, so we accidentally picked up some of them when we trained Grok on a large amount of web data. This was a huge surprise to us when we first noticed it. For what it’s worth, the issue is very rare and now that we’re aware
RESEARCH
-
Meta’s EfficientSAM: 20x Smaller, 20x Faster Vision Model
By
–
New paper- A few months ago, Meta released Segment Anything Model (SAM). It's already in photography apps, medicine, and video-generation. Now the Team invented SAM’s little brother, EfficientSAM. It is small but mighty! ****
With 20x fewer parameters and 20x faster -
ChatGPT-4 Outperforms Gemini Ultra in Direct Comparison
By
–
ChatGPT-4 in the hand >>> Gemini Ultra in the bush
-
OpenAI Evals Repository Receives Testimonial Addition
By
–
Adding this to the OpenAI evals repository on Github as a testimonial
-
LLMs Impact on AI and Linguistics Debates
By
–
http://
rodneybrooks.com/blog post covering some of my opening keynote on Nov 28th for MIT's Generative AI Week is now up. This is one of the topics I talked about–the impact of the existence of LLMs on three long running debates in AI & linguistics. I have this handle at bsky social. -
Avoiding Awful Products: The Risk of Optimization Without Understanding
By
–
Two easy steps for making an absolutely awful product: 1. Have no clue about what you are doing. 2. Optimize step number 1.
-
Mixture of Experts Routing History in Language Models
By
–
The idea of MoE/routing for LMs has a long history (e.g. Fig 4 of this 2010 multimodal PAQ LM https://
arxiv.org/pdf/1108.3298.
pdf
…) but executions and not just the idea matter a lot, and we should welcome every advance. Matt Mahoney attributes the idea to @SchmidhuberAI -
LLMCompiler: Open Source Framework for Parallel LLM Agent Task Execution
By
–
New Paper Alert -LLMCompiler If you enjoyed @karpathy
's video on an "LLM OS", you're going to want to check out this paper (complete with a full open source repo!) This system compiles an effective plan for executing multiple tasks in parallel, letting LLM agents work -
Putin Accelerates Russia’s AI Development to Counter Western Dominance
By
–
Putin to boost AI work in Russia to fight a Western monopoly he says is 'unacceptable and dangerous' https://
bit.ly/3GtskWi #AI #MachineLearning #DeepLearning #LLMs #DataScience -
OpenAI’s Internal Crisis Over Artificial Intelligence Future
By
–
Inside OpenAI’s Crisis Over the Future of Artificial Intelligence: