I threw this out there as a half-joke. Now I'm getting dozens of DMs with generous people + companies offering to sponsor the compute. Really appreciate all the support! I have to think about the best way to do this (if at all). Will report back later today.
COMPUTING
-
EU Digital Skills Strategy Shaping Europe’s Future Workforce
By
–
Digital skills | Shaping Europe’s digital future https://
digital-strategy.ec.europa.eu/en/policies/di
gital-skills
… via @EU_Commission #digitaleu #digital #europe #education #skills #workforce #consumers #innovation #Technology @DigitalEU @ArturHabant @elaniaz @Fabriziobustama @CurieuxExplorer @Shi4Tech @Hana_ElSayyed -
Evaluating Speed Cost and Offline AI Performance Metrics
By
–
Speed, cost and the ability to run offline on a personal device are the things I care most about I still don't have a great answer for how to best evaluate these things but I'm researching that at the moment
-
Google’s Machine Learning Energy Costs: Fact or Fiction?
By
–
> Google alone spends 75% of its electrical cost only on machine learning today i've read this somewhere, but I'm wondering if there's a reference source for this claim?
-
Training costs for 8B parameter models relatively affordable
By
–
Couple hundred. Pretty cheap b/c only 16K on 8B
-
70B Model Context Window Limitations and Hardware Requirements
By
–
Ooof. I don't know if 128K is possible on the 70B, unless someone can get me a rig with like 16 or more A/H100s. 32K is likely doable though.
-
Seeking $500 Compute Sponsorship for AI Project
By
–
If someone wants to sponsor the compute, I can do it! Would only need like $500 of compute.
-
Faster AI Inference Enables More Thinking Same Time
By
–
The model will output the same result, no matter the speed. What faster inference enables is more thinking in the same amount of time.
-
Running AI Applications on Budget Laptops: RAM Requirements
By
–
Presumably this one but I'm surprised it runs at all on a cheap laptop, @damnkittyworks how much RAM do you have?