MoE very efficient and compress context KV store. Both noted in today’s post
SOFTWARE
-
Running Your Own AI: More Options Available
By
–
There is nothing quite like the feeling of running your own AI. More great options than ever.
-
Building Custom Tools with OpenAI o1 for SWE-Bench
By
–
🆕 short pod – how @shawnup got SOTA SWE-Bench Verified
— Latent.Space (@latentspacepod) 28 janvier 2025
with @openai o1… by building his own tools (on @weights_biases Weave) to look at data! https://t.co/clyqvZNhHQ pic.twitter.com/ALmUSSAjiJshort pod – how @shawnup got SOTA SWE-Bench Verified with @openai o1… by building his own tools (on @wandb Weave) to look at data!
-
Questioning the necessity of LLM-based operating systems
By
–
Except, I don't know if we want/need an LLM-based OS . Reminds me a bit of the web 3.0 on blockchain topic
-
llama.cpp enables easy local model execution
By
–
llama.cpp is the best! It’s wild that one can run a model of this size at the click of a button
-
Lower-precision formats and distilled models enabling local long-context LLMs
By
–
Me neither :). I think with new lower-precision formats, and better distilled models, we'll maybe increasingly adopt long-context LLMs run locally.
-
DeepSeek Privacy: US/EU Hosted Open Source Model
By
–
DeepSeek on Perplexity is hosted in US/EU data centers – your data never leaves Western servers. The open source model is hosted completely independent of China. Your privacy and data security is our priority.
-
Software Reset: Building Selfish Products in the AI Era
By
–
ai reset the game board for software. there's a ton of low-hanging fruit for products to build—and its cheaper every day. the best thing to build? what you want to use. this is the age of selfish software
-
Perplexity adds US-hosted DeepSeek R1 reasoning
By
–
BREAKING 🚨: Perplexity released US-hosted DeepSeek R1 reasoning option 👀 https://t.co/Wm5KT4bmpO pic.twitter.com/yKnzCQCt7n
— 🚨 AI News | TestingCatalog (@testingcatalog) 27 janvier 2025BREAKING : Perplexity released US-hosted DeepSeek R1 reasoning option
-
DeepSeek-R1-distill now on Groq
By
–
NEW : DeepSeek-R1-distill model is now available on groq It performs less than a full o1 but is much faster. * keep in mind that this is not a DeepSeek R1