so TIL that Claude Code and the like are written in *React* you can just write HTML & js and certain packages will render it for you. it looks way better than regular terminal output. interesting
@jxmnop
-
Geoffrey Hinton Confirmed as AI Legend
By
–
i always suspected geoffrey hinton was an absolute legend
-
LLAMA 5 Vision: Dense Multimodal Model Across Four Sizes
By
–
if it were up to me, there would be a LLAMA 5 it would be dense. it would be multimodal. it would come in four sizes: 1B, 8B, 80B, 800B. it would be iterated upon until the 8B LLAMA 5 totally outperformed the 80B LLAMA 3. this would be a huge asset to the community.
-
Learning Bits Through RL and SFT: Research Insights
By
–
best paper or blog i've read in a while, highly recommend! John is brilliant and his research sets an example for the rest of us. recently i too have been thinking deeply about how many bits might be learned via one step of RL or SFT.. if you're thinking about this too, lmk!
-
AI Progress, Evals, and Reinforcement Learning in Job Market
By
–
quite a privilege to be a guest on Odd Lots! talked w joe & tracy about pace of progress in AI, broken evals, the crazy job market, and the difference between supervised and reinforcement learning
-
Transformers Need 56.9B Parameters to Memorize Wikipedia
By
–
by the way. recently wrote a paper on this! for transformers, the number is about 3.6 bits-per-parameter so you would need 25GB ÷ 3.6 bits ≈ 56.9B parameters to exactly memorize Wikipedia that’s a pretty big model actually
-
RoPE Encoding: Technical Discussion on Language Models
By
–
these models don’t use RoPE but you’re probably directionally correct
-
AI Models Limited by Missing Training Data for New Hardware
By
–
i could definitely be wrong, but my thinking is that models are very good at doing problems that have similar solutions in their training data at the time of release for every new line of GPUs, there is no training data available
-
Kernel Writing Skills Command Premium Salaries in AI Job Market
By
–
out of all my AI PhD friends on the job market this year, the ones that did the best (by far) write kernels. companies are paying out the wazoo for this skillset models approaching human-level performance in kernel-writing over the next year looks pretty unlikely
-
Human-Only Social Networks: The Bot Spam Solution
By
–
the trendlines indicate that one day this app will be overrun by hordes of bots producing low quality difficult-to-identify slop and at this point someone will be forced to build the first true Humans-Only social network. No Bots Allowed. Fingerprint Required