ModernBERT is not a chat model.
MACHINE LEARNING
-
Top 10 AI Innovations Transforming 2025 Across Industries
By
–
Top 10 AI Innovations Reshaping 2025: 1. AI + Quantum Computing
2. Reinforcement Learning
3. Explainable AI
4. Language Modeling
5. AI in Healthcare
6. AI in Drug Discovery
7. AI in Cybersecurity
8. AI in Metaverse
9. AI in Big Data
10. AI in Agriculture & Transport Save -
Foundation Models Improved With Domain-Specific Training Data
By
–
Foundation models are great at public knowledge, but fall short on domain-specific tasks. That’s why we’re working with the brightest in their fields to build high-quality training data that actually makes AI useful. Want to learn more? https://
snorkel.ai/expert-communi
ty/
… -
Fine-tuning as continued pretraining improves medical AI
By
–
Your daily reminder that fine tuning is just continued pretraining. Super cool results from @antoine_chaffin who is putting this knowledge into practice to improve medical AI:
-
Qwen3 32B: Revolutionary 3x Larger Context Window
By
–
Qwen3 32B. Over 3x the context window of everyone else. It’s not even close.
-
Running Model Comparisons Across Hugging Face Repository
By
–
yeah ig it’s expensive but you could presumably run this for every model diff pair on huggingface
-
Anthropic’s Model Diffing Reveals Post-Training Effects on LLMs
By
–
just learned about "model diffing" from Anthropic. buried in an october blogpost; feels really novel. training a 'crosscoder' between two models of the same family produces interpretable diffs. here post-training clearly adds refusals, QA, math, etc. pretty amazing stuff
-
Reading Recognition Dataset from Egocentric Wearable Sensors
By
–
Reading Recognition in the Wild: A Dataset for Understanding Human Behaviors During Reading from an Egocentric Sensor Suite This large multimodal dataset features video, eye gaze, and head pose sensor outputs, created to help solve the task of reading recognition from wearable
-
Sonata: Self-Supervised Learning Breakthrough for 3D Point Representations
By
–
Sonata: Advancing Self-Supervised Learning for 3D Point Representations Sonata represents a significant leap forward in the field of 3D self-supervised learning. By identifying and addressing the geometric shortcut and introducing a flexible, efficient framework, it’s an