I’m not sure most companies have a use for this (we certainly won’t use it at HyperWrite, due to the sheer size / performance ratio). But still a really cool development for the Snowflake team!
@mattshumer_
-
Hidden Reasoning in AI Interfaces Through Tag Parsing
By
–
If you control the interface, you can even have it reason within tags and then parse them out so the user doesn’t see.
-
Phi Models Performance Issues and User Experience Concerns
By
–
I've never had good results from Phi models. Something always feels really off/broken…
-
Compute Sponsorship Offers Pour Projet IA Non Annoncé
By
–
I threw this out there as a half-joke. Now I'm getting dozens of DMs with generous people + companies offering to sponsor the compute. Really appreciate all the support! I have to think about the best way to do this (if at all). Will report back later today.
-
Understanding AI Models Through Conversation and Testing
By
–
I usually just start by saying “hi” to the model, and go from there. It takes time to really understand how well a model works.
-
Extended Base Model Development and Implementation
By
–
For clarity, I extended the base model — not the instruct version, so this is expected.
-
Phi-3 Announced: GPT-3.5 Rival Runs on Smartphones
By
–
Phi-3 was just announced! Benchmarks rival GPT-3.5, but the model can be run on a phone. BUT — as with all (tiny) models, benchmarks tell us less than vibes.
-
Training costs for 8B parameter models relatively affordable
By
–
Couple hundred. Pretty cheap b/c only 16K on 8B
-
70B Model Context Window Limitations and Hardware Requirements
By
–
Ooof. I don't know if 128K is possible on the 70B, unless someone can get me a rig with like 16 or more A/H100s. 32K is likely doable though.
-
Seeking $500 Compute Sponsorship for AI Project
By
–
If someone wants to sponsor the compute, I can do it! Would only need like $500 of compute.