(Getting it working with how they handle reasoning traces soon.)
CODE
-
TinySwallow-1.5B: Knowledge Distillation for Japanese Language Models
By
–
この度、新手法「TAID」を用いて学習された小規模日本語言語モデル「TinySwallow-1.5B」を公開しました。https://t.co/U7qpbz2BgL
— Sakana AI (@SakanaAILabs) 30 janvier 2025
私たちは、大規模言語モデル（LLM）の知識を効率的に小規模モデルへ転移させる新しい知識蒸留手法「TAID (Temporally Adaptive Interpolated… pic.twitter.com/OUCy71ho42この度、新手法「TAID」を用いて学習された小規模日本語言語モデル「TinySwallow-1.5B」を公開しました。 https://
sakana.ai/taid-jp 私たちは、大規模言語モデル（LLM）の知識を効率的に小規模モデルへ転移させる新しい知識蒸留手法「TAID (Temporally Adaptive Interpolated -
OpenAI Realtime API Solar System Demo Now Open Source
By
–
One of our most popular @OpenAI DevDay demos is now open source!
— Romain Huet (@romainhuet) 29 janvier 2025
Dive into @kagigz’s interactive, voice-navigable solar system, and learn how you can build your own speech-to-speech experiences with the Realtime API.https://t.co/5tHJDeVloY https://t.co/jUlkGzqiXbOne of our most popular @OpenAI DevDay demos is now open source! Dive into @kagigz
’s interactive, voice-navigable solar system, and learn how you can build your own speech-to-speech experiences with the Realtime API. https://
github.com/openai/openai-
realtime-solar-system
… -
Crowdsourced Distributed Fine-Tuning: A Year-Long Advocacy
By
–
I've been arguing for something like this for over a year: crowdsourced distributed fine-tuning.
-
OpenAI o1 Model Enhances LLM Reasoning Through Inference Compute
By
–
HuggingFace: "OpenAI’s o1 model showed that when LLMs are trained to do the same—by using more compute during inference—they get significantly better at solving reasoning tasks like mathematics, coding, and logic."
-
LangGraph State Management Primitives Now Accessible Beyond Framework
By
–
excited to make low level primitives for state management accessible outside of LangGraph next up: higher level, off-the-shelf implementations for short and long term memory
-
MIT CSAIL PhD Students Share Favorite AI Programs
By
–
MIT CSAIL PhD students weigh in on their favorite AI programs.
— MIT CSAIL (@MIT_CSAIL) 29 janvier 2025
Full video: https://t.co/9wQBknTvpT pic.twitter.com/zFNNZUn0etMIT CSAIL PhD students weigh in on their favorite AI programs. Full video: https://
bit.ly/4gltvqi -
Custom Queue Integration with Drupal 11 Framework
By
–
Learn how to create a custom queue, along with the queue factory needed to integrate that queue, with @Drupal 11 https://
bit.ly/3CrQ4M1 #drupal #drupal11 #opensource #openweb -
SAS Viya Workbench: Free Cloud Coding Environment for Students
By
–
Fast. Flexible. Free. SAS Viya Workbench for Learners is a cloud-based coding environment designed for students and educators. Available now! http://
2.sas.com/6019xBR7B -
Open Source Requirements: Data Transparency Beyond Code and Weights
By
–
For something to be open source, we need to see 1. Data it was trained & evaluated on
2. Code
3. Model architecture
4. Model weights. DeepSeek only gives 3, 4. And I'll see the day that anyone gives us #1 without being forced to do so, because all of them are stealing data.