Yup, the amount of capabilities unlocked from the long context is hard to grasp. My tests here are just scratching the surface
LLMS
-
Gemini 1.5 Pro Achieves 99.2% Accuracy on 10M Token Context
By
–
Yes, yes, and yes “For text, Gemini 1.5 Pro achieves 100 percent recall up to 530k tokens, 99.7 percent up to 1M tokens, and 99.2 percent accuracy up to 10M tokens”
-
Gemini LLM Unlocks New Capabilities for App Development
By
–
Felt surreal to watch Gemini ingest multiple transcripts and spit out accurate details in less than a minute. So many LLM capabilities just unlocked. So many more apps will be built
-
Testing Long Audio and Codebase Integration for AI Systems
By
–
I do, but I didn’t have 11 hours of audio on my computer to upload. Will test out long audio + codebases for the next tests when I get a window
-
AI Model Accuracy Confirmed on Extended Context Testing
By
–
I didn’t believe it at first, but after testing can confirm it’s fully accurate on long context and also very detailed (at least for all the tests I ran)
-
Gemini 1.5 Deep Dive: AI Insights and Tinkering
By
–
One last thing. I spent my entire Saturday night tinkering on Gemini 1.5 so I could give you this early content. If you found it valuable, spare me a follow @rowancheung for more deep AI insights.
-
Gemini 1.5 Extracts Key Insights from Interstellar Transcript
By
–
6. Understanding the entire Interstellar movie transcript, and highlighting key moments.
— Rowan Cheung (@rowancheung) 18 février 2024
Gemini 1.5 was able to tell me the 3 most inspiring quotes from the transcript of Interstellar. pic.twitter.com/4xakHSAch06. Understanding the entire Interstellar movie transcript, and highlighting key moments. Gemini 1.5 was able to tell me the 3 most inspiring quotes from the transcript of Interstellar.
-
Gemini 1.5 Translates to Ultra-Rare Languages Successfully
By
–
3. Translating language into a language spoken by less than 2000 people.
— Rowan Cheung (@rowancheung) 18 février 2024
Gemini 1.5 was able to translate English to Saterlandic (spoken by less than 2000 people) following a full linguistic manual at inference time.
Absolutely incredible. pic.twitter.com/kDCOpbqyD33. Translating language into a language spoken by less than 2000 people. Gemini 1.5 was able to translate English to Saterlandic (spoken by less than 2000 people) following a full linguistic manual at inference time. Absolutely incredible.
-
Gemini 1.5 Compares Full Movie Transcripts for Viewing Decisions
By
–
2. Understanding and comparing full movie transcripts from Interstellar and Ad Astra.
— Rowan Cheung (@rowancheung) 18 février 2024
Gemini 1.5 was able to understand, compare, and contrast entire transcripts from both movies to help me decide which movie I should watch. pic.twitter.com/WU2Epr8WWq2. Understanding and comparing full movie transcripts from Interstellar and Ad Astra. Gemini 1.5 was able to understand, compare, and contrast entire transcripts from both movies to help me decide which movie I should watch.
-
Gemini 1.5 Analyzes NBA Dunk Contest Video with Long Context Understanding
By
–
1. Breaking down + understanding a long video
— Rowan Cheung (@rowancheung) 18 février 2024
I uploaded the entire NBA dunk contest from last night and asked which dunk had the highest score.
Gemini 1.5 was incredibly able to find the specific perfect 50 dunk and details from just its long context video understanding! pic.twitter.com/01iUfqfiAO1. Breaking down + understanding a long video I uploaded the entire NBA dunk contest from last night and asked which dunk had the highest score. Gemini 1.5 was incredibly able to find the specific perfect 50 dunk and details from just its long context video understanding!