Some considerations:
It works surprisingly well, not many changes needed besides, of course, the different way @ollama inference works. I just had to add some more info in the prompt for the orchestrator because Llama 3 loves to yap, lol. At one point, it forgot the goal and
OPEN SOURCE
-
Ollama Integration with Llama 3 Orchestration Works Well
By
–
-
Meta Llama 3 Impresses Despite Smaller Model Size
By
–
Meta Llama 3 is very good, especially for such a small model. We can put in a multi-page prompt like our negotiation simulator (
https://
moreusefulthings.com/student-exerci
ses
…) & it is able to follow the complexity reasonably well. It doesn’t have the “smarts” of GPT-4 class, but impressive nonetheless. -
Maestro-Ollama: Local Llama 3 70B Agent Framework
By
–
Introducing Maestro-Ollama! 🦙
— Pietro Schirano (@skirano) 18 avril 2024
You can now harness the power of the Maestro framework entirely locally using Llama 3 70B via @ollama.
Let that sink in for a second, this is a model that outperforms Claude 3 Sonnet, operating as an agent, completely locally.
What a time! 🔥 pic.twitter.com/aC34Bd6F65Introducing Maestro-Ollama! You can now harness the power of the Maestro framework entirely locally using Llama 3 70B via @ollama
. Let that sink in for a second, this is a model that outperforms Claude 3 Sonnet, operating as an agent, completely locally. What a time! -
LLaMA 3 Long-Context Training Timeline Awaited
By
–
Great! Any timeline there? Waiting to really push hard on training LLaMA 3 till I can use long-context.
-
Perplexity Labs Launches Llama 3 Models with Search Integration
By
–
http://
labs.perplexity.ai and brought up llama-3 – 8b and 70b instruct models. Have fun chatting! we will soon be bringing up search-grounded online versions of them after some post-training. also available on pplx-api, and you get 5$ monthly API credits if you're already -
François Chollet discusses AGI and Keras 3 on People of AI
By
–
I went on the People of AI podcast to talk about AGI, Keras 3, and a bunch of other things. Check it out!
-
Llama 3 8B Performance Comparable to Llama 2 70B Model
By
–
The model card has some more interesting info too: https://
github.com/meta-llama/lla
ma3/blob/main/MODEL_CARD.md
… Note that Llama 3 8B is actually somewhere in the territory of Llama 2 70B, depending on where you look. This might seem confusing at first but note that the former was trained for 15T tokens, while the -
Llama 3 8B and 70B Now Available on Poe
By
–
Both Llama 3 8B and 70B are available at https://
poe.com/Llama-3-8B-T and https://
poe.com/Llama-3-70B-T and across all Poe apps. (2/2) -
Llama 3 70B Now Available on Poe Platform
By
–
Llama 3 is now available on Poe! Llama 3 70B is now the most powerful open source model available, with state-of-the-art performance across industry benchmarks. It delivers new capabilities like enhanced reasoning, better code generation, and improved instruction following. (1/2)
-
Meta’s Llama 3 Congratulations and AI Progress Recognition
By
–
@AIatMeta is one of the best things ever happened to AI progress. Congrats on llama 3! https://
ai.meta.com/blog/meta-llam
a-3/
…