Can't wait to meet more of the developer community tomorrow at the Open Source Agent Hackathon with @AndrewYNg
. As always, we'll be increasing rate limits for any hackers building on Groq. See you there! https://
hubs.la/Q02KT_Fp0
OPEN SOURCE
-
Groq Increases Rate Limits for Open Source Agent Hackathon
By
–
-
Local execution and model download capabilities for lighting
By
–
Is it running locally? Does lighting allow to download model?
-
Readme contains numerous examples for deploying different modalities
By
–
If you check the readme, there are tons of of examples on deploying different modalities
-
Official Lightning AI LitServe Repository Link Shared
By
–
Here's the official repo: https://
github.com/Lightning-AI/l
itserve?utm_source=akshay
… -
LitServe Launch: Next-Generation AI Model Serving Engine
By
–
Super exited to announce that we've Launched LitServe! The next-gen serving engine for AI models—lightning fast , scalable. – 2x faster than FastAPI (at least)
– GPU autoscaling
– Batching, streaming
– LLMs, NLP, vision
– PyTorch, SkLearn, Jax…
– … 10+ features Star -
Jamba-1.5 Whitepaper Released: Hybrid SSM-Transformer Models
By
–
Jamba-1.5 whitepaper is out!
The whitepaper details the architecture, training schemes, novelties and in-depth evaluations of our new long context hybrid SSM-Transformer models – Jamba-1.5-Large and Jamba-1.5-Mini. Arxiv: https://
arxiv.org/abs/2408.12570 Here are some highlights and -
LM Studio v0.3 Released with Improved User Interface
By
–
Also enjoying the v0.3 of @LMStudioAI
, the new UI is slick -
Open-Source LLMs: Unsung Pioneer in AI Evolution
By
–
Doesn't get enough credit but IMO paved the way for open-source LLMs!
-
Stable FP8 Training Recipe for Llama Models
By
–
Summary of stable FP8 training recipe for Llama models:
1. Clip learning rate when 2nd moment estimator is outdated by coming spike – see https://
arxiv.org/abs/2304.13013
2. SmoothQuant: smooths activation outliers by migrating the quantization difficulty to weights – see -
Open Source Strategy: Commercial Failure or Planned Decision?
By
–
Was open source always the goal, or did sales not go well?