Fair, I meant that the best GPT-4 answers exceeded the average human answer, there was lots of variability.
LLMS
-
Training Techniques for AI Layer Alignment with Tokens
By
–
Yeah, and then training on like 10 million tokens to align the layers
-
Merging Mistral-7B Models into Mistral-70B: Feasibility and Use Cases
By
–
I kinda want to make a Mistral-70B by frankenmerging 10 Mistral-7Bs together. Would anyone find this useful?
-
Similar AI Model Development Work Across Organizations
By
–
Wild — we seem to be working on a ton of similar things (opus -> haiku etc.) 🙂
-
Fine-tuning requires robust evaluation systems to be effective
By
–
"It’s impossible to fine-tune effectively without an eval system which can lead to writing off fine-tuning if you haven't completed this prerequisite." That sounds spot-on to me. Eval systems still feel like a dark art, which would explain why I don't find fine-tuning attractive
-
New Open Source Project: Custom Fine-Tuned Model Generation
By
–
Dropping another new open source project tomorrow Type in a prompt, and out comes a fully custom, fine-tuned model Excited to share it
-
LLM as Global Mind: Hegel’s Spirit in AI
By
–
Hegel used the term to describe the universe looking at itself, through the spirit of human culture. The LLM is quite literally a global mind, distilled from the entirity of shared written cultural production if humanity. The prompt constrains it into a single contextual identity
-
Enterprise LLM spending surges with 2-5x budget increases planned
By
–
A new report from a16z / @sarahdingwang surveyed top enterprises on AI adoption, finding that both attitudes and investments have shifted dramatically. This stat was shocking: Enterprise spending on LLMs averaged $7M in 2023, with 2-5x budget increases planned for 2024.
-
GPT-4 Problem Solving: LLMs Match Human Creativity
By
–
AI as problem solver: A test of LLMs on "MacGyver-like" problems requiring novel solutions Out-of-the-box, GPT-4 only does okay, but when prompted to "think" conveniently & divergently, it is close to the average human, and can exceed them in many cases. https://
arxiv.org/pdf/2311.09682
.pdf
… -
Waiting for GPT to release agents and become smarter
By
–
Let’s just wait till GPT drops agents and becomes smarter. I’ll be patient