1h prompt cache is nuanced actually. It costs more for cache writes, and less for cache reads. Whether you benefit from cheaper cache reads depends on your usage pattern — context window size, whether the query is the main agent or subagent, etc. We have been testing a
@bcherny
-
Prompt Cache Pricing: Read vs Write Cost Trade-offs
By
–
1h prompt cache is nuanced actually. It costs more for cache writes, and less for cache reads. Whether you benefit from cheaper cache reads depends on your usage pattern — context window size, whether the query is the main agent or subagent, etc. We have been testing a
-
Claude Code Token Usage Default: Transparency and User Choice
By
–
This is false. We defaulted to medium as a result of user feedback about Claude using too many tokens. When we made the change, we (1) included it in the changelog and (2) showed a dialog when you opened Claude Code so you could choose to opt out. Literally nothing sneaky about
-
TypeScript Performance: Simplifying Build Without Native Dependencies
By
–
TS felt simpler if we could make it fast — no napi, no native builds, no per platform vendoring
-
Claude Code v2.1.85 Faster Mentions Feature Released
By
–
Enjoy faster @-mentions in Claude Code! This went out in v2.1.85.
-
Performance optimization strategies for file search systems
By
–
The wins came from three places: 1. Pre-computing upfront in a clever way that doesn't block the main thread
2. Avoiding NAPI overhead for small result sets
3. Iteratively asking Claude to find perf improvements for faster file search -
Claude Code introduces fileSuggestion setting for large codebases
By
–
But in big codebases, it would fall over. So we introduced a new fileSuggestion setting in Claude Code, so customers with large codebases could plug in their custom code index (using SourceGraph, an in-house index, etc.). https://
code.claude.com/docs/en/settin
gs#file-suggestion-settings
… -
Porting Rust NAPI File Indexer to Native TypeScript with Opus
By
–
To simplify our system, I asked Opus to port the file indexer to native TypeScript. Here's the prompt I used: > compile our rust+napi file index to native ts. compile the code over, and make sure the code perfectly passes the ORIGINAL test suite from the package. then profile
-
TypeScript Port Delivers 3x P99 Performance Improvement
By
–
After a few hours, I had a PR. The results were solid — P99 got 3x faster after porting to TypeScript!