Gemini 1.5 — 10M tokens and the demos to prove it can use them. So many implications here. Why SFT when you can 100K-shot? And if it can translate Kalamang given a grammar and dictionary, what *can’t* the right words teach it? Prompting is poised to eat everything.
BIG TECH
-
OpenAI’s Strategic Release Timing Against Competitor Announcements
By
–
Feels like OpenAI has an entire vault of releases lined up for whenever a competitor drops something to take over headlines
-
Meta’s V-JEPA Model Predicts Video Content with Limited Information
By
–
Meta released V-JEPA, a new learning model for AI to understand and predict what is going on in a video, even with limited information. It learns by predicting missing or obscured parts of a video in its internal feature space.
-
Google Unveils Gemini 1.5 with Groundbreaking 1M Token Context
By
–
Google just revealed an upgraded Gemini 1.5 model—featuring a groundbreaking 1M token context window (up to 10M in testing).
— Rowan Cheung (@rowancheung) 16 février 2024
The LLM can now process considerably more data than competitors and enables (previously unimaginable) capabilities. https://t.co/AIdn9OoUgFGoogle just revealed an upgraded Gemini 1.5 model—featuring a groundbreaking 1M token context window (up to 10M in testing). The LLM can now process considerably more data than competitors and enables (previously unimaginable) capabilities.
-
OpenAI Sora: Text-to-Video AI Model Transforms Gaming
By
–
OpenAI introduced Sora, an insane text-to-video AI model.
— Rowan Cheung (@rowancheung) 16 février 2024
Notably, the model can generate video up to 60 seconds from both text prompts and still images and can also insert scenes within existing video.
The AI video game just completely changed.https://t.co/cXkIl12OPpOpenAI introduced Sora, an insane text-to-video AI model. Notably, the model can generate video up to 60 seconds from both text prompts and still images and can also insert scenes within existing video. The AI video game just completely changed.
-
Major AI Breakthroughs: OpenAI, Google, Meta Dominate News
By
–
Historic day in AI. First, OpenAI changed the AI video world and Google made enormous progress in LLM capabilities. Then we saw huge developments from Meta, Slack, CodeSignal, X/Grok, Microsoft, University of Michigan, LangChain, and Magic. Here's EVERYTHING you need to know:
-
Google’s disregard for language sovereignty in AI systems
By
–
Also, forgive me if I don't exactly expect Google to be respectful of things like language sovereignty.
-
Apple Develops Text-to-Image Models, Rumored Siri LLM Overhaul
By
–
Apple has some interesting text-to-image and image-to-image models they've been working on. Rumor is we'll be getting an overhauled Siri with an Apple-built LLM announcement at WWDC. But I don't have concrete evidence of that yet.
-
OpenAI ChatGPT Updates: This Week’s Major AI Announcements
By
–
I'm planning on making another "This Week in AI News" style video for tomorrow and it's probably going to have another "Insane Week" kind of title that so many people tell me they hate. LOL But here's what's happened in the past 72(ish)-hours: – OpenAI announced that ChatGPT
-
OpenAI reportedly using GPT-5 as research assistant
By
–
Totally agree with that. But I think it's not a far-fetched scenario to imagine OpenAI at this point has been using GPT-5 in some form, and maybe as a "research assistant" in this case.