GPT-3 model is GPT-2 but trained for longer (300B) tokens and yes on a better dataset. FineWeb is a good dataset, so you can train your own like this. It will cost ~$500. Use -b 32 -t 2048 instead to use the 2048 GPT-3 context length to be accurate.
GENERATIVE AI
-
Siri Blames ChatGPT for Hallucination, Claims Apple Purity
By
–
"It wasn't me hallucinating," said Siri. "It was ChatGPT. I'm a pristine Apple product."
-
Apple’s ChatGPT Partnership Mirrors IBM’s Historic Microsoft Deal
By
–
Apple outsourcing its chatbot to OpenAI is like IBM outsourcing its PC operating system to Microsoft.
-
Simplifying Architectural Design Workflows with AI
By
–
Simplify Architect Design with AI Enhances productivity, fosters creativity • Explore tool options
• Integrate into workflow
• Boost collaboration Read more: https://
buff.ly/4bx4c2O -
GPT-3 4th Anniversary: Re-training Smallest Model Achievement
By
–
Apparently today is the 4th year anniversary of GPT-3! https://
arxiv.org/abs/2005.14165 Which I am accidentally celebrating by re-training the smallest model in the miniseries right now :). HellaSwag 33.7 (Appendix H) almost reached this a few steps ago (though this is only 45% of the -
Reverse Turing Test: Which AI Among Famous Figures?
By
–
They conducted a reverse Turing Test with 4 AIs. There were 5 famous figures on a train, and they had to figure out which among them was the human. The video has 140k views, was made in Unity and voiced through ElevenLabs, and pitted GPT-4-Turbo, Claude 3 Opus, Llama 3, and
-
ChatGPT Free Tier Expands Access to Advanced AI Features
By
–
Providing widespread access to cutting-edge AI features via ChatGPT Free tier:
-
Google Models Not Deployed By Google Itself
By
–
Article notes Google has other models available. Which Google itself isn’t using
-
Generative AI Becomes Most Deployed AI Solution in Organizations
By
–
#GenerativeAI Is Now the Most Frequently Deployed #AI Solution in Organizations https://
linkedin.com/posts/marcusbo
rba_ai-generativeai-genai-activity-7201613660522188802-UtDb
… #GenAI #MachineLearning @mvollmer1 @CurieuxExplore @lyakovet @HeinzVHoenen @enilev @Eli_Krumova @CatherineAdenle @Damien_CABADI @FmFrancoise @AkwyZ @avrohomg @BIScorecard -
Sharing perspectives on open-source AI and LLaMA 3
By
–
Enjoyed sharing my thoughts on open-source AI and LLaMA 3 for today’s @nytimes piece. Thanks @MikeIsaac for including my perspective!