Just read through the Gemma 3 report and toyed around with the models a bit, and there are a bunch of interesting tidbits: 1. Vocab size. They again use a very large vocab: 262k token (in contrast, Llama 3 has ~1/2 the vocab size), which should make the model more friendly for
@rasbt
-
Uncertainty about Gemma and Gemini model similarities
By
–
sure, I don't know though how much Gemma and the flavor of Gemini they are using there have in common though.
-
Local Model Comparison Issues with Llama and Alternatives
By
–
When trying them out locally, they usually compared favorably to Llama etc. What were the issues you were having?
-
Gemma Models: Underestimated LLMs with New Technical Report Released
By
–
Great news! Gemma models are one of the most underestimated LLMs imho. The technical report is available here: https://
storage.googleapis.com/deepmind-media
/gemma/Gemma3Report.pdf
… -
Congratulations on new model release and request for research paper
By
–
Big congrats! The Gemma 2 model was awesome, and I look forward to trying this one! Btw is there a paper forthcoming similar to Gemma 2? Would love to read about it in more detail!
-
Using Meta pretrained weights without training or image tokens
By
–
Hm, did you use the pretrained weights from Meta? Does the model work fine if you don't do any training and don't pass any image tokens?
-
Positive Experience with Waymo Autonomous Vehicle Rides
By
–
Oh yes for sure. I took a few Waymo rides a few months ago, and they were awesome.
-
App Development Boom Encourages Building Personal Custom Applications
By
–
I hope this app development boom encourages me/more programmers to build personal & custom apps more often
(just as we have always built our own command-line tools for all kinds of things) -
AI-Generated Code Won’t Reach 90% Adoption Soon, Expert Says
By
–
I think it is more realistic to look at what happened with human-written text. ChatGPT (in 2022) is making a huge difference in how we write. But I wouldn't say that 90% of text is AI-generated (yet). Similarly, I don't think that 90% of code is going to be AI generated in 3-6
-
Self-Driving Cars: Marketing Hype versus Technical Reality
By
–
I remember the timeline of self-driving cars… 90% marketing, 10% reality.