Phi-3 was just announced! Benchmarks rival GPT-3.5, but the model can be run on a phone. BUT — as with all (tiny) models, benchmarks tell us less than vibes.
@mattshumer_
-
Training costs for 8B parameter models relatively affordable
By
–
Couple hundred. Pretty cheap b/c only 16K on 8B
-
70B Model Context Window Limitations and Hardware Requirements
By
–
Ooof. I don't know if 128K is possible on the 70B, unless someone can get me a rig with like 16 or more A/H100s. 32K is likely doable though.
-
Seeking $500 Compute Sponsorship for AI Project
By
–
If someone wants to sponsor the compute, I can do it! Would only need like $500 of compute.
-
LLaMA 3 Context Window Doubled to 16K Tokens Open-Source
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
LLaMA 3 Context Window Extended to 16K Tokens Open-Source
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
LLaMA 3 Context Window Doubled to 16K Tokens
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
Context Length Extension Testing and Performance Benchmarks
By
–
I haven't run real benchmarks on it (if anyone wants to, that'd be awesome!), but from my homemade haystack tests, the context length extension worked well.
-
LLaMA 3 Context Window Doubled to 16K Tokens
By
–
I've doubled LLaMA 3's context window to 16K tokens. Fully open-source. Link in thread:
-
Evaluation Loss in Model Training: Understanding Its Role
By
–
eval loss. i don't always use it, as it's not a great measure, but it's good for things like this