company / product specific benchmarks are incredibly helpful
@officiallogank
-
Internal Evals vs Public Benchmarks in AI Model Assessment
By
–
many have evals internally, far fewer have released public benchmarks
-
Automation Tools Create Alpha for Founders and Businesses
By
–
Folks like @zapier
, @SierraPlatform
, and many others are already doing this. So much alpha to be created here. If you are a founder or business owner, your team should be doing this tomorrow. -
Companies Should Build Custom AI Benchmarks for Competitive Advantage
By
–
Every company building on top of AI should be making their own benchmarks. This is the way if you want model progress to disproportionally benefit your company.
-
Gemini Engine Room Achieves Full Speed for Best-in-Class Coding
By
–
the engine room is running at full speed to make Gemini best in class at coding, progress is all positive : )
-
Raw Intelligence: Structuring Data for Better AI Partners
By
–
so much raw intelligence, lots of work to wrangle it into the most useful thought partner out there
-
Google AI Studio Hiring Technical Staff Members
By
–
We are hiring a bunch of Members of the Technical Staff for @GoogleAIStudio who can blend PM, design, eng, and more If this is you, pls DM me, we will move fast for the best people.
-
Deep Research Token Usage and Billing Models
By
–
Deep Research does use a lot of tokens, and it bills directly to the underlying models it uses behind the scenes (flash and pro).
-
New TPU Generation Shows 2-3x Performance Improvement Over Ironwood
By
–
Huge improvements over Ironwood TPU’s (2-3x), can’t wait to see Gemini in action with these : )