CUDA has been on my to-learn list since 2011.
(Worked in a molecular dynamics lab that used it, but I never really learned it.)
Maybe it's finally time to take the plunge. (But then, I also saw the AI CUDA Engineer announcement yesterday….)
@rasbt
-
Considering Learning CUDA After 14 Years
By
–
-
GPU hours usage confirmation and cluster utilization questions
By
–
Is it confirmed that they used more GPU hours? Sure, they have that 200k GPUs cluster, but did they use all that for the final model run or is it more to facilitate multiple parallel experiments?
-
Phi-4 Model Release: 40% Synthetic Data Composition
By
–
Phi-4! (
https://
arxiv.org/abs/2412.08905). 40% synthetic. -
SFT and RL Training Pipeline: Limitations of Cold Start Approach
By
–
Yes & no. They had SFT (cold start) → RL → SFT (CoT + knowledge) → RL. Not sure if they focused on providing solutions to hard problems via SFT CoT though, because that SFT data was just generated from the previous model (so if that model doesn't solve it, then you are stuck)
-
Alternating SFT and RL Training for Improved Model Policy
By
–
I wonder if alternating SFT (with correct solutions) and RL can help here. I.e, SFT → RL → SFT → RL. SFT would help with improving the initial policy and help making the exploration less random perhaps, plus it expands/refines the search space?
-
Model Performance Comparisons: Size Normalization and Inference Scaling Challenges
By
–
Model performance comparisons are tricky without knowing exact sizes; it could be an apples-to-oranges case. Plus, you can always push numbers with inference scaling. Normalizing by tokens/sec would be more meaningful.
-
DeepSeek Inference Runs on Huawei Chips Despite Model Restrictions
By
–
For many models, yes. But DeepSeek inference is hosted on Huawei chips , for example.
-
Science Thrives Through Shared Knowledge and Collaborative Effort
By
–
> "Science is better when shared. Scientific progress is a collective effort. […] We plan to frequently publish technical blog posts, papers, and code […]"
Thank you! -
GPT-5: An AI Dropdown Menu to Select the Right Model
By
–
Plot-twist: GPT-5 is an AI-powered dropdown menu that picks the right model for the task