there are lots of cool inference-scaling techniques out there! More to come in my next Ahead of AI post
@rasbt
-
Key Insights from Annual Machine Learning Competitions Report
By
–
Every Spring, I'm excited to read through the comprehensive ~100-page "State of Machine Learning Competitions" report, which offers many interesting insights into current trends, useful tools, and emerging methodologies in the field. Below are some key takeaways from the latest
-
OpenAI’s Reasoning Approach: Response Generation as Better Term
By
–
It's an OpenAI thing (
https://
openai.com/index/learning
-to-reason-with-llms/
…). I think "Response generation" would probably be a better, more general term. -
Focus on Writing About Reasoning Models Over Video Content
By
–
Good question. Currently, I am more focused on writing about reasoning models (vs making videos on reasoning models) because the research landscape if evolving so quickly. Probably I'll make one in the future (more likely 2026ish) once the methodology converged.
-
End-to-End Encryption vs AI Computing Server Requirements
By
–
Interesting. I am surprised that they need it for AI computing but not for iCloud storage. But maybe because the data is send and stays end-to-end-encrypted whereas with AI computations you have to at least temporarily decrypt it on the server to run the query & computation.
-
AI-Generated Content Cannot Replace Authentic Human Creators
By
–
100%. I also don't even like AI-generated audiobooks or podcasts. I just can't listen to them. That's why, for me, they will never replace awesome creators & channels like @3blue1brown
. (The only thing is maybe they make the work easier / enable even higher quality videos for -
Companies Developing LLMs for Code Generation
By
–
Companies specifically focusing on developing LLMs for code generation. There are the obvious ones, but I also know a couple of startups who are laser-focused on this.
-
LLMs struggle with TikZ figures but code generation training improves automation
By
–
Yes, LLM also still struggle with Tikz-generated figures etc. I can imagine though that with all the focus on code-generation training, this will be easier to automate.
-
Apple’s Cloud Infrastructure Choices for AI and Storage Services
By
–
Interesting point. They still use Google Cloud for their iCloud storage service with end-to-end encryption (except UK); so I am surprised they wouldn't consider using similar cloud compute services for their AI workloads until they have their own hardware up and running.
-
Concern about the misuse of the term distillation
By
–
I mean, look what they've done to the term "distillation" in the last few weeks