I guess I have to learn rust now huh
@mattlynley
-
Local Bot Quest for Automated Writing Tasks
By
–
tbf writing is my least favorite part of this job but my year-long quest to build a local bot (explicitly not an API) that can successfully do this part of my job for me has thus far not been successful
-
Loading Multiple Models Simultaneously with Llama CPP
By
–
Has anyone tried loading two models into memory w/ llama cpp? Like an 8bit Mistral 7B and a 4bit Mixtral simultaneously.
-
MLX Framework Generates Excitement Similar to Jupyter Discovery
By
–
I feel like the last time I’ve had as much fun as I have had messing around with mlx was like when I discovered Jupyter for the first time?
-
Impact of Benchmark Improvements on Real User Experience
By
–
I’d really love to know what kind of meaningful difference a percentage point or two on a benchmark has on an end user experience if anyone has done work on that!
-
Choosing Mac Hardware for Local LLM and Vector Database Setup
By
–
depends. if you just want to surf and blog, just get an air. If you want a Miqu-1 Q4 (or Q5 with a teensy ctx window) attached to a chroma db locally, I'd say get a Max with some beefy memory.
-
MacBook Pro Battery Life Achievement During Extended Work
By
–
AI is cool and all but so far the most underrated thing about the future is that I've been working from bed while sick for like three days and I have yet to have to charge my macbook pro.
-
S3 Bucket Analytics: Data Security Risks Without Sanitization
By
–
Analytics with naive chunking except instead of periods it’s entire S3 buckets. Table sanitization is for losers.
-
Claude API Access Now Available to Users
By
–
“You now have Claude API access” pic.twitter.com/B800bqGIVF
— Matthew Lynley (@mattlynley) 16 février 2024“You now have Claude API access”