applying large-scale RL to chains of cope written by human seethers, we observe an “lmao moment” upon which the model spontaneously exhibits superhuman snark
MACHINE LEARNING
-
David beats Goliath: breakthroughs without massive AI resources
By
–
if you find david beating goliath to be a bizzare surprising story, read history?
if you think state of the art in AI cannot possibly be achieved without massive resourcing, go read the AlexNet paper or read about Alec Radford's accomplishments? -
Massive Resources Not Required for AI Breakthroughs
By
–
if you find david beating goliath to be a bizzare surprising story, read history?
if you think state of the art in AI cannot possibly be achieved without massive resourcing, go read the AlexNet paper or read about Alec Radford's accomplishments? -
Sakana AI Proposes Transformer² with Two-Stage Reasoning
By
–
東京発Sakana AIが新たな「Transformer」を提案 https://
xtech.nikkei.com/atcl/nxt/colum
n/18/02801/012200014/
…
Transformer²は2段階の推論プロセスを採用している。
１段階目では、プロンプトを試験的に実行してAIモデルの挙動を観察し、実行に必要なスキルを理解する。 -
o1 smarter than R1, but R1 shows CoT better
By
–
I think o1 is smarter than R1 too; I just mean because you can see the CoT, R1 is better for showing someone how o1 works
-
Training AI by Scraping Other AI Models Instead of Web
By
–
Turns out that instead of scraping the web to train an AI, you can just scrape the AI that scraped the web.
-
AI in Healthcare: Threat or Opportunity for the Future
By
–
Is Artificial Intelligence in Healthcare a Ticking Time Bomb or Timely Solution?
#AI #AIio #BigData #ML #NLU #Futureofwork @IIoT_World @ipfconline1 @jblefevre60 @JimMarous @insurtechtalk @KirkDBorne @kuriharan @LouisSerge -
Reasoning Less Competitive Moat Than Expected in 2025
By
–
2025's biggest surprise so far: Reasoning is less of a moat than anyone thought.
-
Best ArXiv Papers Read Throughout 2024
By
–
Ha, yeah, it's basically the "best of" of the arxiv slice I read in ~365 days in 2024 😛
-
PhD Research on Attention Architecture and NLP Benchmarks
By
–
This gave me a good chance to reflect on my phd years, it was a pretty fun time. I mostly did tons of architecture work, played around a lot on attention blocks, recurrence etc. Felt like a professional lego builder. I was playing on the SNLI, MNLI, Squad leaderboards etc,