They really need KV caching though – otherwise the pricing is just not competitive. (OTOH if they *do* add caching at a good price point, they will be amazing!)
LLMS
-
Peak Moments of Presence: Glitches in the Simulation
By
–
workslop ain’t work. accountants dont last long if they make errors.
-
X/Twitter Post Mentions xAI’s Grok-4 Model
By
–
Some guy generalized from a single (and impossible) example of teacher incompetence to produce the most toe nail curling argument against tech in schools ever. Can we admit that teaching writing to humans was a bad idea?
-
Top 6 Claude Code Skills for Newbies, Including Skill-Creator
By
–
bro A new video just dropped, still super dry, still newbie-friendly, highly recommend it here, video link at the end. "I Tried Over 100 Claude Code Skills, These 6 Are the Best". 1. skill-creator Official from Anthropic, usage is straightforward to the max: Let Claude write
-
Request for AI Model Traces and Hugging Face Model
By
–
Could you share your traces and the resulting model on HF? Would be super interesting
-
Dense Attention: A Technical Direction in AI Models
By
–
All related to dense attention, can be considered the same direction, with the same approaches.
-
LLM pricing per token mirrors SaaS era, buy a GPU
By
–
Charging $ per 1M tokens
Is basically the SaaS era of LLMs That’s why I keep saying Buy a GPU