GPT-4o-latest (gpt-4o-2024-0806) ranks above the prior GPT-4o (May 2024) on: – Math (now #2 behind Claude 3.5 Sonnet)
– Coding (now #2 behind Claude 3.5 Sonnet) but actually performed worse than the May model on Instruction Following (now ranked #8) and Spanish (now ranked #3)
LLMS
-
GPT-4o-latest outperforms May 2024 model on math and coding
By
–
-
Gemini-1.5-Pro-Exp tops leaderboards in instruction following coding
By
–
Gemini-1.5-pro-exp-0827 ranks higher than the May model version on all leaderboards: – Instruction Following (now #3 behind Llama and Claude)
– Coding (now #4 behind Claude, GPT-4o, and Mistral)
– Math (now #7) -
Mistral Large 2 Achieves Top Rankings Across Coding Math Benchmarks
By
–
Mistral Large 2 (mistral-large-2407) also improves on Mistral Large on all leaderboards, and performed quite well: – Coding (#3 behind Claude and GPT-4o)
– Instruction Following (now #6)
– Math (now #8)
– Spanish (now #4 behind GPT-4o May, Gemini 1.5 Pro, and GPT-4o August) -
SEAL Leaderboard Adds GPT-4o, Gemini 1.5 Pro, Mistral Large 2
By
–
SEAL Leaderboard Update We added 3 new models to the SEAL Leaderboards: – GPT-4o-latest (gpt-4o-2024-08-06)
– Gemini 1.5 Pro (Aug 27, 2024) (gemini-1.5-pro-exp-0827)
– Mistral Large 2 (mistral-large-2407) More detailed results in thread -
Transformers Agents now supports multi-agent systems for better performance
By
–
Transformers Agents now supports Multi-agent systems! Multi-agent systems have been introduced in Microsoft's framework Autogen. It simply means having several agents working together to solve your task instead of only one : this paradigm empirically yields better performance
-
Gemini update brings file and photo uploads to iOS
By
–
Gemini changelog got updated: “Go Live with Gemini” I still don’t have it on iOS and have it for a week already on Android. But on iOS there is also a new addition – now you can upload files and photos
-
BigLlama-3.1-1T Upload Triggers Community Flashbacks
By
–
This gave me flashbacks of BigLlama-3.1-1T's upload
-
Nvidia LlamaIndex Developer Contest RAG Applications Opportunity
By
–
Check out this amazing opportunity to participate in the Nvidia and LlamaIndex Developer Contest where they encourage you to build retrieval-augmented generation (RAG), agentic, or beyond-agentic RAG applications in any domain.
Regissterlation link: https://
developer.nvidia.com/llamaindex-dev
eloper-contest?ncid=ref-inor-494422
… -
OpenAI GPT-Next, Nvidia antitrust, AI agents civilization
By
–
Top stories in AI today: -OpenAI Japan reveals ‘GPT-Next’ details
-Nvidia hit with antitrust subpoena
-How to run Phi-3.5 on your phone
-Autonomous AI agents form civilizations
-6 new AI tools & 4 new AI jobs Read more: http://
therundown.ai/p/openai-gpt-n
ext-2024-release
…