Thanks, but there are no open weights yet, right? Asking because it would be impossible to cover architecture details without open weights and/or a detailed technical report
@rasbt
-
State Space Models in Gallery Updates
By
–
I have models with state space layers in the gallery (e.g., Nemotron 3). Anything since April I missed though?
-
Shared Experts Reduce Redundancy in Mixture-of-Experts Models
By
–
It can learn shared patterns so that the individual experts don’t have to relearn the same info; ie it’s to reduce redundancy among the non-shared experts
-
April 2025 AI Architecture Drops: Six New Models Released
By
–
Here is a 2nd batch of April architecture drops. What a month!
– Ant Ling 2.6 1T
– Minimax M2.7
– Xiaomi MiMo V2.5
– Poolside Laguna XS.2
– Tencent Hy3-preview
– IBM Granite 4.1 -
Bookmarking Latest AI Models: Laguna, Ling, Xiaomi MiMO, Minimax
By
–
Awesome, thanks. I am bookmarking all of these and will add as soon as time permits:
– Laguna XS.2
– Ling 2.6
– Xiaomi MiMO v2
– Minimax M2.7
– Tencent Hy -
Open Weight Models Matter for AI Transparency
By
–
Yeah but not open weight so not really possible to say anything interesting about the model itself
-
DeepSeek V3.2 MLA Architecture with Sparse Attention
By
–
I'd say it's not standard MLA but like with MLA + DeepSeek Sparse Attention in V3.2 it's MLA but with CSA/HCA (i.e., not plain MLA but they do keep the latent KV representation)
-
Open-Weight Model Release Status and API Availability
By
–
Yes, but I couldn't find the open-weight version yet. I don't think it's released, yet (except for the API version)?
-
Xiaomi MiMo V2.5 ASR Models Open Weights Search
By
–
I actually looked for them but didn't find the open weights. I only found their ASR models, which are different? https://
huggingface.co/XiaomiMiMo/MiM
o-V2.5-ASR
… -
Higher Resolution LLM Architecture Gallery and Summaries
By
–
Higher res figures (and summaries) in the LLM architecture gallery: