LLaMA (Large Language Model Meta AI) achieves results competitive with the best currently released models while being smaller & more efficient — increasing accessibility to this technology for more researchers working on this important subfield of AI across the globe.
INNOVATION
-
AI Platform Accelerates Business Value and Revenue Growth
By
–
We are committed to providing an AI Platform helping teams deliver faster time to value, increased revenue, and reduced costs. How do we do it? Register for our March 16 virtual event to find out more. #AIVisiontoValue https://
bit.ly/3KeMdU3 -
LLaMA-65B Outperforms Chinchilla and PaLM on Reasoning Benchmarks
By
–
On Common Sense Reasoning, Closed-book Question Answering, and Reading Comprehension, LLaMA-65B outperforms Chinchilla 70B and PaLM 540B on almost all benchmarks.
4/n -
Open Dataset Approach: LLaMA’s Reproducible Alternative to Chinchilla and GPT-3
By
–
Unlike Chinchilla, PaLM, or GPT-3, we only use datasets publicly available, making our work compatible with open-sourcing and reproducible, while most existing models rely on data which is either not publicly available or undocumented.
2/n -
Models trained on 1T tokens with continued improvement at 7B scale
By
–
All our models were trained on at least 1T tokens, much more than what is typically used at this scale.
Interestingly, even after 1T tokens the 7B model was still improving.
3/n -
MathGPT: AI-powered mathematical problem solving with code
By
–
MathGPT Use GPT3 to solve math problems, and get the code behind each solution: https://
mathgpt.streamlit.app #Artificialintelligence #ChatGPT #DeepLearning -
Jim Keller Interview: Tenstorrent AI Hardware Innovation
By
–
Thanks @IanCutress https://
morethanmoore.substack.com/p/interview-wi
th-jim-keller-tenstorrent?utm_source=twitter&utm_campaign=auto_share&r=1ilwc6
… -
Neural Networks Are Decision Trees: Key Research Insights
By
–
Neural Networks are Decision Trees Caglar Aytekin: https://
arxiv.org/abs/2210.05189 #ArtificialIntelligence #DeepLearning #NeuralNetworks -
Future AI-CPU Integration and Processor Architecture Flexibility
By
–
“In the future, AI and CPU integration is going to be interesting… I don't want to have to ask permission to add a data type or a port from the processor to this or change how the data movement engine works – I just want to be able to do it.” @jimkxa