GENERATIVE AI

→ View original post on X — @tunguz

Gemini Pro Launched: Performance Compared to GPT-3.5

By

@tunguz

–

06 December 2023 17h23

Gemini Pro is available right now and you can check it out in Bard. That version, according to Google, is slightly better than GPT-3.5, so in other words Gemini in production is about a year behind OpenAI's capabilities. 3/4

→ View original post on X — @tunguz

Google Gemini Closing Gap Against OpenAI Next Generation Models

By

@tunguz

–

06 December 2023 17h23

It remains to be seen if they can close that gap in the upcoming months, as I'm sure @OpenAI has also been working diligently on their next generation model. Read the full blog post announcement here: https://
blog.google/products/bard/
google-bard-try-gemini-ai/
… #AI #ArtificialIntelligence #GenerativeAI #GenAI 4/4

→ View original post on X — @tunguz

Google Gemini Ultra Benchmarks Beat GPT-4 Across Categories

By

@tunguz

–

06 December 2023 17h23

The benchmarks that Google shared for Gemini Ultra look really impressive, and seem to be generally beating GPT-4 in almost all categories. However, as of right now, Gemini Ultra is still not available, and will not be available until some time early next year. 1/4

Evaluating Google’s Titan and PaLM Embeddings with MTEB Benchmarks

By

–

06 December 2023 17h21

Here I am trying to figure out how I can get MTEB scores for Titan and PaLM embeddings and doing GPU hour math and I'm not cool enough to get a technical report for a Big Boy Model from Google.

Gemini Model Card Analysis Delayed by Jury Duty

By

–

06 December 2023 17h18

Still reading through the model card/report on Gemini (which I did not make the pre-brief cut for this one, alas) so issue will be coming later due to getting called in for jury duty yesterday!

Google Missed Opportunity Renaming AI Hallucinations

By

–

06 December 2023 17h15

(Also very much a missed opportunity for Google to rename hallucinations here, which is a terrible name for it.)

Data Quality Over Quantity: Gemini’s Intentional Uncertainty Handling

By

–

06 December 2023 17h13

Data quality > data quantity, as we've been talking about since september :). Fun part here, it includes examples where Gemini intentionally throws up its hands (like another model out there). You'd be surprised how useful people think this is. https://
supervised.news/p/ai-in-septem
ber-reasoning-engines
…

→ View original post on X — @runwayml

Runway Gen-2: AI Video Generation Tool for Creative Storytelling

By

@runwayml

–

06 December 2023 17h05

Tell a story in any style with Gen-2.https://t.co/ekldoIshdw pic.twitter.com/iq6IuWHlkz
— Runway (@runwayml) 6 décembre 2023

Tell a story in any style with Gen-2. http://
runwayml.com

Google adopts Meta’s approach training smaller models massive datasets

By

–

06 December 2023 17h04

And Google now running with Meta's approach of training smaller models with massive data sets. If you're curious about size, the open source RedPajamas open data set is 30T tokens. We can prob safely assume Google has access to much more.