Planning to do this for the base model, at least at first. It's more of a learning thing for me, to help me perfect the context length extension approach so I can do it for our internal HyperWrite stuff… so I don't want to do too many variations.
@mattshumer_
-
LLaMA 3 8B Extended to 16K Token Context Window
By
–
Training a LLaMA 3 8B that supports 16K tokens, twice the current context window. If successful, will open-source it.
-
Data Congruency Critical for Fine-Tuning LLMs in Products
By
–
When fine-tuning LLMs for products, data congruency is so important.
-
Rope Scaling: Advanced Approaches for LLM Optimization
By
–
Many approaches — look into Rope scaling as a start.
-
8K Models: Limitations and Advanced AI Use Case Requirements
By
–
Whoever said that is wrong. Sure, some use-cases are possible with 8k, but the interesting ones require more.
-
Community Long-Context LLaMA 3 Variants: What Exists?
By
–
Are there any long-context LLaMA 3 variants that the community has trained yet?
-
Open-Source Model Beats Claude 3 Opus at 300 Tokens Per Second
By
–
We now have an open-source model that is beating Claude 3 Opus…
— Matt Shumer (@mattshumer_) 19 avril 2024
being served at nearly **300 tokens per second** on @GroqInc.
The applications built off of this tech will be nothing short of revolutionary. pic.twitter.com/v934g0rwU5We now have an open-source model that is beating Claude 3 Opus… being served at nearly **300 tokens per second** on @GroqInc
. The applications built off of this tech will be nothing short of revolutionary. -
Groq Serves LLaMA 3 at Record 800 Tokens Per Second
By
–
My mind is blown.@GroqInc is serving LLaMA 3 at over 800 tokens per second!
— Matt Shumer (@mattshumer_) 19 avril 2024
800. Tokens. Per. Second.
This unlocks so many incredible use-cases.
It's one thing to see my demo — it's another thing entirely to experience it for yourself.
Do yourself a favor and try it asap. pic.twitter.com/Rd5NW5SDlWMy mind is blown. @GroqInc is serving LLaMA 3 at over 800 tokens per second! 800. Tokens. Per. Second. This unlocks so many incredible use-cases. It's one thing to see my demo — it's another thing entirely to experience it for yourself. Do yourself a favor and try it asap.
-
HyperWrite Launches Fine-Tuned LLaMA 3 Model
By
–
An initial HyperWrite fine-tune of LLaMA 3 is working and we're evaluating it in the HyperWrite platform. Will iterate, then ship to users soon!
-
LLaMA 3 Long-Context Training Timeline Awaited
By
–
Great! Any timeline there? Waiting to really push hard on training LLaMA 3 till I can use long-context.