You should be fine tho, they are quantized GGUF
OPEN SOURCE
-
Open Source AI Risks Lower Than Centralized Model Control
By
–
Very well made argument. Risks of open source are way lower than risks of any one powerful actor owning the most capable model pic.twitter.com/1eYKZC6QAl
— Aravind Srinivas (@AravSrinivas) 18 avril 2024Very well made argument. Risks of open source are way lower than risks of any one powerful actor owning the most capable model
-
Popular LLM Training Frameworks: Hugging Face Transformers Axolotl UnSloth
By
–
in the community: huggingface transformers, axolotl, unsloth, lit-gpt are popular options.
-
Serverless Fine-tuning and Serving for Llama3 on Predibase
By
–
Check out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! 🦙
— Predibase by Rubrik (@predibase) 18 avril 2024
🔥 Blazing fast serverless inference – #8b & #70b variants
🖌️ #Finetune in the UI or SDK via config
🌳 Start prompting your fine-tune instantly with #LoRAXhttps://t.co/L3Tv8r07P1 pic.twitter.com/GAOW88SfZzCheck out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! Blazing fast serverless inference – #8b & #70b variants #Finetune in the UI or SDK via config Start prompting your fine-tune instantly with #LoRAX https://
pbase.ai/3VZE37X -
Serverless Fine-tuning and Serving for Llama3 on Predibase
By
–
Check out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! 🦙
— Predibase by Rubrik (@predibase) 18 avril 2024
🔥 Blazing fast serverless inference – #8b & #70b variants
🖌️ #Finetune in the UI or SDK via config
🌳 Start prompting your fine-tune instantly with #LoRAXhttps://t.co/Rq8fsQwaZl pic.twitter.com/CYON9Wx25ZCheck out #serverless fine-tuning and serving for #Llama3 on @Predibase with our free trial! Blazing fast serverless inference – #8b & #70b variants #Finetune in the UI or SDK via config Start prompting your fine-tune instantly with #LoRAX https://
predibase.com/free-trial -
Ollama Integration with Llama 3 Orchestration Works Well
By
–
Some considerations:
It works surprisingly well, not many changes needed besides, of course, the different way @ollama inference works. I just had to add some more info in the prompt for the orchestrator because Llama 3 loves to yap, lol. At one point, it forgot the goal and -
Meta Llama 3 Impresses Despite Smaller Model Size
By
–
Meta Llama 3 is very good, especially for such a small model. We can put in a multi-page prompt like our negotiation simulator (
https://
moreusefulthings.com/student-exerci
ses
…) & it is able to follow the complexity reasonably well. It doesn’t have the “smarts” of GPT-4 class, but impressive nonetheless. -
Maestro-Ollama: Local Llama 3 70B Agent Framework
By
–
Introducing Maestro-Ollama! 🦙
— Pietro Schirano (@skirano) 18 avril 2024
You can now harness the power of the Maestro framework entirely locally using Llama 3 70B via @ollama.
Let that sink in for a second, this is a model that outperforms Claude 3 Sonnet, operating as an agent, completely locally.
What a time! 🔥 pic.twitter.com/aC34Bd6F65Introducing Maestro-Ollama! You can now harness the power of the Maestro framework entirely locally using Llama 3 70B via @ollama
. Let that sink in for a second, this is a model that outperforms Claude 3 Sonnet, operating as an agent, completely locally. What a time! -
LLaMA 3 Long-Context Training Timeline Awaited
By
–
Great! Any timeline there? Waiting to really push hard on training LLaMA 3 till I can use long-context.
-
Perplexity Labs Launches Llama 3 Models with Search Integration
By
–
http://
labs.perplexity.ai and brought up llama-3 – 8b and 70b instruct models. Have fun chatting! we will soon be bringing up search-grounded online versions of them after some post-training. also available on pplx-api, and you get 5$ monthly API credits if you're already