5/ Fact Recalling in LLMs – studies how MLP layers implement a lookup table for factual recall; suggests that early MLP layers act as a lookup table and recommends thinking about the recall of factual knowledge in the model as multi-token embeddings.
LLMS
-
Math-Centric Corpus for Generative AI Foundation Models
By
–
6/ Generative AI for Math – presents a diverse and high-quality math-centric corpus comprising of ~9.5 billion tokens to train foundation models.
-
PromptBench: Unified LLM Evaluation and Prompt Engineering Library
By
–
3/ PromptBench – a unified library that supports comprehensive evaluation and analysis of LLMs; it consists of functionalities for prompt construction, prompt engineering, dataset and model loading, adversarial prompt attack, and more.
-
Red-teaming GPT-4 APIs: Fine-tuning, Functions, Retrieval
By
–
4/ Exploiting Novel GPT-4 APIs – performs red-teaming on three functionalities exposed in the GPT-4 APIs: fine-tuning, function calling, and knowledge retrieval.
-
Innovative Multimodal Models Redefine AI Capabilities
By
–
7. Innovative multimodal Models • LLAMA 2, SAM, LLaVA, and more redefine image segmentation, language vision, and advanced Al capabilities.
-
GPT-4 Launch: OpenAI’s Revolutionary Model Amid Controversies
By
–
6. GPT-4 Unveiling and Controversies • OpenAl introduces GPT-4, while controversies unfold, from CEO drama to the launch of Assistants API for building complex Al applications.
-
AI Milestones in 2023: GPT-4, Bard, and Key Breakthroughs
By
–
STOP Scrolling! Good morning AI enthusiasts! Here are some amazing Insights on AI Milestones in 2023 GPT-4, Bard, controversies, and a dynamic year of breakthroughs and challenges in AI
-
Fast Inference of Mixture-of-Experts Language Models with Offloading
By
–
Fast Inference of Mixture-of-Experts Language Models with Offloading Artyom Eliseev, Denis Mazur : https://
arxiv.org/abs/2312.17238 #ArtificialIntelligence #DeepLearning #MachineLearning -
GPT-5 Emergence, AI Films, and Regulatory Debates Ahead
By
–
I'll go first. 1: GPT-5 will come out by June. It will be a huge leap forward. Debates will begin about whether it's AGI or not.
2: We will see the first successful AI film.
3: Calls for AI regulation will get intense due to 2024 election deepfakes + fear over GPT-6. -
GPT-4 Capability to Recognize Knowledge Limits
By
–
was recently thinking about how good gpt-4 seems to be at knowing when it doesn't know something