Very interesting! People love 8B more than 70B.
LLMS
-
Fireworks AI API endpoint request for models list
By
–
@FireworksAI_HQ feature request: it would be great if there was an API endpoint that returned the list of models, I had to hard-code them here for the moment
-
New LLM Fireworks Plugin Enables Access to Advanced Language Models
By
–
New LLM plugin: llm-fireworks, providing access to @FireworksAI_HQ models llm install llm-fireworks
llm keys set fireworks
# paste in API key
llm -m fireworks/models/llama-v3-70b-instruct 'five great names for a pet ocelot' -
Framework Documentation with Tokenizer Support Request
By
–
Your documentation is super well-written, so it was really easy to convert the framework. My only request is that I would like some sort of tokenizer so I can be more precise with the amount of tokens for input and output and build a more robust system around that 🙂
-
Popular LLM Training Frameworks: Hugging Face Transformers Axolotl UnSloth
By
–
in the community: huggingface transformers, axolotl, unsloth, lit-gpt are popular options.
-
Llama 3 Models Now Available in LangSmith Playground
By
–
Try out the latest Llama 3 8B and 70B models in LangSmith Playground today!
— LangChain (@LangChain) 18 avril 2024
Thanks to our friends at @FireworksAI_HQ! https://t.co/0d6H7X71r1 pic.twitter.com/lsC9Cjr3NYTry out the latest Llama 3 8B and 70B models in LangSmith Playground today! Thanks to our friends at @FireworksAI_HQ
! -
Serverless Fine-tuning and Serving for Llama3 on Predibase
By
–
Check out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! 🦙
— Predibase by Rubrik (@predibase) 18 avril 2024
🔥 Blazing fast serverless inference – #8b & #70b variants
🖌️ #Finetune in the UI or SDK via config
🌳 Start prompting your fine-tune instantly with #LoRAXhttps://t.co/L3Tv8r07P1 pic.twitter.com/GAOW88SfZzCheck out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! Blazing fast serverless inference – #8b & #70b variants #Finetune in the UI or SDK via config Start prompting your fine-tune instantly with #LoRAX https://
pbase.ai/3VZE37X -
Serverless Fine-tuning and Serving for Llama3 on Predibase
By
–
Check out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! 🦙
— Predibase by Rubrik (@predibase) 18 avril 2024
🔥 Blazing fast serverless inference – #8b & #70b variants
🖌️ #Finetune in the UI or SDK via config
🌳 Start prompting your fine-tune instantly with #LoRAXhttps://t.co/Rq8fsQwaZl pic.twitter.com/CYON9Wx25ZCheck out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! Blazing fast serverless inference – #8b & #70b variants #Finetune in the UI or SDK via config Start prompting your fine-tune instantly with #LoRAX https://
predibase.com/free-trial -
M3 Max 8B model optimization for multi-agent orchestration systems
By
–
I have an M3 Max with 64GB. You can use the 8B model if you don't have a lot of VRAM. What I realize is that the 8B model works really well as a subagent. As long as the Orchestrator and the Refiner are the 70GB models, the whole thing works really well.