Interesting in-depth read from @BenTheEgg about how PhotoRoom trained their own image model from scratch Another proof point that you should build your own ML capabilities rather than rely on closed AI
GENERATIVE AI
-
Multimodal AI Leaderboard: Measuring Video, Audio, and Long-Context Performance
By
–
Can someone create a leaderboard with metrics that also measure the features Oriol highlights here: 1. multimodal performance: understanding and generating video, audio, touch, actions, proprioception. 2. long-context: long understanding and generation. I agree Gemini 1.5 Pro
-
LLMs analyzing text at runtime capabilities
By
–
For training yes, but I'm talking about LLMs analyzing text at runtime
-
AI Needs Independent Testing Standards Like Consumer Reports
By
–
We need a Consumer Reports or Underwriters Lab for AI testing. All the public benchmarks are game-able and mostly not useful measures of things LLMs do. We need secret test batteries for subject areas (coding, reasoning, human conversation, writing) and secret red team tests, too
-
Claude 3 Creates Original Optical Illusions and Visual Patterns
By
–
I asked Claude 3 to create original optical illusions. You are supposed to see:
— Ethan Mollick (@emollick) 24 avril 2024
"A perception of tilted lines from a pattern of alternating rows of tiles"
"A mesmerizing pattern"
"A square that appears to be breathing or pulsating, even though it's actually just changing size" pic.twitter.com/FrMOAx7isiI asked Claude 3 to create original optical illusions. You are supposed to see:
"A perception of tilted lines from a pattern of alternating rows of tiles"
"A mesmerizing pattern"
"A square that appears to be breathing or pulsating, even though it's actually just changing size" -
Model License Terms and Commercial Use Clarification
By
–
As far as I can tell the license for this model is here – it looks to me like you can use it commercially but I don't recognize the general shape of the license and IANAL
-
Apple releases CoreNet: open neural network training library
By
–
CoreNet looks to be the parent project – brand new on GitHub as of a few hours ago, "a library for training deep neural networks" Includes:
– OpenELM: a brand new LLM with open training data
– CatLIP: a CLIP-like model with more efficient training? More: https://
github.com/apple/corenet -
Apple Releases Significant ML and LLM Research
By
–
Apple appear to have just released a huge volume of fascinating ML and LLM work in one go, I'm still trying to get my head around what they've published here
-
Claude 3 excels at creative puzzle-solving in teaching games
By
–
Claude 3 is pretty good at puzzles. One of our teaching games takes place on a doomed mission to Saturn, and a minor challenge is naming the ship where you are given an over-the-top manual and a set of criteria and have to come up with a name. People struggle, Claude nailed it.