i think i see your point. the embeddings we work with are the average of many tokens’ last-layer activations. so we can’t directly load them back in, need to train a model to do it
CODE
-
System Complexity Undermines Security, Maintainability, Scale, Performance
By
–
"security, maintainability, scale, and performance" are exactly the things most likely to suffer when you create more systems, each with their own interface boundaries.
-
Single Server Architecture for High Performance Systems
By
–
"the correct way to build" is a silly claim. There are many high performance extremely scalable systems built with the simpler design that @levelsio describes. I've done both, and nowadays I stick to keeping things in a single server wherever possible.
-
Claude Code Revenue Drives Anthropic to $100B Valuation
By
–
claude code is >$200m ARR and that helped anthro get to $100b valuation what everybody wants to know is WHAT ARE THE MARGINS on that 200m…
-
Document Embeddings: Arithmetic and Text Decoding Techniques
By
–
I built this during my PhD! you can embed *documents* using the OpenAI embeddings, do arithmetic on them, and then decode them back to text e.g. E = emb(“Elon Musk bought Twitter in 2022”) – emb(“Elon Musk”)
vec2text(e) = “Someone bought twitter in 2022” -
Claude Code’s File Function Name Memory Limitations
By
–
if you ask it to do something, it usually starts with: let me find where in the code base this is implemented. it'd guess what a name a file/function should be, and search for it. it surprises me that Claude Code doesn't keep track of all the file/function names. feels like a
-
Mistral Launches Audio Transcription API Endpoint
By
–
The good news is that Mistral also offer a new dedicated /v1/audio/transcriptions endpoint which appears to transcribe audio without being confused by instructions embedded in that audio
-
AI Automation Eliminates Repetitive Code Work Forever
By
–
i feel intense pang of nostalgia thinking about how i will never have to write an immense amount of repetitive code to eg build a website ever again. there was a quiet bluecollar satisfaction to this type of work, knowing that if you don’t stay up all night smacking keys the
-
Anthropic’s API Focus Over Apps Strategy
By
–
I believe Anthropic's main focus is their API and not their apps. Most of Anthropic's users seem to use it directly from tools like Cursor, Windsurf, etc.
-
Journey from Cursor to Building Claude Code
By
–
> Build Claude Code
> success.jpg
> Cursor seems pretty good I wonder what they do
> lightbulb.jpg
> /join cursor
> /leave cursor
> Build Claude Code