Both Jamba 1.5 models are faster than competitors of a similar size, with up to 2.5X faster inference on long contexts. [3/6]
LLMS
-
Jamba 1.5 Models: Hybrid SSM-Transformer Architecture Innovation
By
–
The Jamba 1.5 models are based on our novel hybrid SSM-Transformer architecture, which combines the quality, speed and efficiency of both. Jamba 1.5 Mini has 12B active/52B total parameters, while Large is 94B active/398B total – the largest Mamba model ever made. [2/6]
-
Jamba 1.5 Model Family: Detailed Benchmarks and Performance Metrics
By
–
We wanted to share some more granular details about the Jamba 1.5 model family – and specific benchmarks on latency, context window, and quality. [1/6]
-
LoRA: Breakthrough in Efficient LLM Fine-tuning
By
–
Thrilled to feature LoRA this week! Published in 2021, LoRA offered a breakthrough in the ability to train and fine-tune LLMs efficiently. Author @edwardjhu will be responding to your questions and comments!
-
Jabberwacky Dialogs Appeared in LLaMA Training Data
By
–
jabberwacky is a pre-LLM chatbot and dialog examples from it appear in llama’s training data so it often appears to assume that context (for the particular chat syntax openrouter adds)
-
Claude Adds LaTeX Rendering Support for Mathematical Equations
By
–
We've added support for LaTeX rendering as a feature preview. Claude can now display mathematical equations and expressions in a consistent format.
-
Head-to-Head Latency Test Results Comparison
By
–
We ran a head-to-head #latency test, with the same hardware and same prompts.
— AI21 Labs (@AI21Labs) 22 août 2024
Want to guess who won? 🤔 pic.twitter.com/SJGTKk7SCLWe ran a head-to-head #latency test, with the same hardware and same prompts. Want to guess who won?
-
Cursor Raises $60M for AI-Powered Coding Platform
By
–
We've raised $60M from Andreessen Horowitz, Jeff Dean, John Schulman, Noam Brown, and the founders of Stripe and Github. Cursor has become recognized as the best way to code with AI, powered by an ensemble of custom and frontier models, delightful editing, and petabyte-scale
-
Midjourney, OpenAI, Microsoft Launch Major AI Updates
By
–
Big News:
• Midjourney: New editing tool and 25 free images for new users.
• OpenAI: Fine-tune GPT-4o with 1M free tokens/day till Sept 23.
• Microsoft: 3 new Phi-3.5 models with near state-of-the-art performance. #Microsoft #OpenAI #Midjourney #ChatGPT #AIImages -
Jamba 1.5 Mini and Large Models Released on Hugging Face
By
–
Jamba 1.5 Mini and Large on Hugging Face: https://
huggingface.co/collections/ai
21labs/jamba-15-66c44befa474a917fcf55251
…