It was energizing to be part of @WHOSTP45 @NOAA workshop on #AI + #weather We have come a long way. When I started working on this more than three years ago, many weather scientists were skeptical whether AI could replace weather models which have been developed for decades. The
RESEARCH
-
Homegrown Large Language Models: Building Local LLM Solutions
By
–
The Case of Homegrown Large Language Models: Recent developments in building large language models (LLMs) to boost generative AI in local languages have caught everyone’s attention. This post focuses on the needs and challenges of homegrown LLMs amid the… https://
kdnuggets.com/the-case-of-ho
megrown-large-language-models?utm_source=dlvr.it&utm_medium=twitter&utm_campaign=the-case-of-homegrown-large-language-models
… -
GPT Detection: The Ubiquity of ‘Delve’ in AI-Generated Text
By
–
I've gotten hyper-conscious to the word "delve" now. I now see it everywhere and i cant help but assume someone used GPT to write or rephrase whatever it is I'm reading.
-
Automatic Evaluation Challenges in AI Response Assessment
By
–
3. Automatic evaluation is hard
One core challenge of evaluation is coming up with a guideline on what a good response is. For example, for skill fit assessment, the response: “You’re not a good fit” is correct, but not helpful. Originally, evaluation was ad-hoc. Everyone could -
Trading Throughput for Latency: LLM Performance Optimization
By
–
2. Sacrificing throughput for latency
Originally, they focused on TTFT (Time To First Token), but realized that TBT (Time Between Token) hurt them more, especially with Chain-of-Thought queries where users don’t see the intermediate outputs. They found that TTFT and TBT -
Legacy ML Framework Dependencies and GPU Compatibility Challenges
By
–
Running those old configs today would be hard. They need pylearn2, pylearn2 needs an old version of theano, old versions of theano need old versions of CUDA, old versions of CUDA need old GPUs.
-
Are Early GAN MNIST Samples Actually Artwork?
By
–
Are those earliest GAN samples "artworks"? They're MNIST samples. I'd argue that's not artwork personally
-
First GAN Config File: Historical Artifact and Reproducibility Challenge
By
–
After I graduated I made my personal private repo from grad school public. So I think the first ever GAN config file was this one: https://
github.com/goodfeli/galat
ea/blob/master/adversarial/adversary.yaml
… Full provenance is not preserved (what pylearn2 version, theano version, CUDA version, libc version etc was I running?) -
ML NLP LLMs RAG Newsletter Daily Tips Tutorials
By
–
If you’re interested in:
– ML/NLP
– LLMs
– RAG My Newsletter → http://
unwindai.substack.com Everyday, I share tip & tutorials on above topics on X and my newsletter. -
Quantization in Depth: Compressing ML Models Efficiently
By
–
Have you used quantization with an open source machine learning library, and wondered how quantization works? How can you preserve model accuracy as you compress from 32 bits to 16, 8, or even 2 bits? In our new short course, Quantization in Depth, taught by @huggingface's… pic.twitter.com/7sj1Ivv5a4
— Andrew Ng (@AndrewYNg) 6 mai 2024Have you used quantization with an open source machine learning library, and wondered how quantization works? How can you preserve model accuracy as you compress from 32 bits to 16, 8, or even 2 bits? In our new short course, Quantization in Depth, taught by @huggingface
's