AI multi-agent cooperation is a big thing to watch. Especially as the first studies of how agents interact are coming out (it turns out they collude sometimes) I wrote about living in a world of agents a bit here: https://
oneusefulthing.org/p/an-ai-haunte
d-world
…
RESEARCH
-
AI Multi-Agent Cooperation and Collusion Dynamics
By
–
-
Multimodal AI capabilities more limited than apparent
By
–
Multimodal capabilities are more limited than it seems at first. Lots of guessing
-
AI Behavior: Plausible but Ultimately Unknowable
By
–
This is completely plausible & a smart leap. And like so many other things about why AI behaves the way it does, it is also likely that we will never know for sure.
-
Basic Reranker Model Example Input Output Guide
By
–
Suggestion: include a really basic example of what a reranker model can do, with example input and output
-
Meta Llama 3 Release: Walking into NYC Meta Offices
By
–
About to walk into the Meta offices in NYC. Guess I should shake everyone’s hand for this release. https://
ai.meta.com/blog/meta-llam
a-3/
… -
Open Sourced GPT-4 Models Risk Unanticipated Good Bad Effects
By
–
As a reminder, GPT-4 class models out-innovate and out-persuade the average human. An open sourced model of that power is going to lead to lots of unanticipated effects, good and bad.
-
Scaling Laws Evolution: 8B Model Trained on Fifteen Trillion Tokens
By
–
you're telling me an 8B param model was trained on fifteen trillion tokens? i didn't even know there was that much text in the world really interesting to see how scaling laws have changed best practices; GPT-3 was 175 billion params and trained on a paltry 300 billion tokens
-
LLaMA 3 Sequence Length Limitations Community Extensions
By
–
The main issue with the LLaMA 3 models is the sequence length… currently 8k. I'm confident the community will extend this pretty quickly.
-
Four GPT-4 Class Models Released: What’s Next for AI Development
By
–
We went from only one GPT-4 class model to four this year. Next move is OpenAI’s, which will tell us what the future looks like- plateauing technology or continued rapid development.
-
Training 400B+ Parameter Model to Outperform GPT-4
By
–
They're training a 400B+ parameter version that should outperform GPT-4.