We’re rolling out API access and capcity as fast we can!
COMPUTING
-
SambaNova’s SN40L RDU 5nm Accelerator for Trillion-Parameter AI
By
–
SambaNova accepted at ISSCC! We’re taking the stage tomorrow to share our paper on the SN40L RDU—a 5nm 2.5D accelerator with three memory tiers designed for trillion-parameter AI. #AI #ISSCC2025
-
Mistral AI unveils Saba, a 24B Arabic/Indian dialect model
By
–
BREAKING : Mistral AI released Saba, a new 24B parameter model that excels in Arabic and Indian dialects. Hyperlocal small models are the future? In general, it covers an interesting niche market
-
The Power of Storytelling With Data Visualization
By
–
The power of storytelling with #data
— Pascal Bornet (@pascal_bornet) 17 février 2025
Source:100people#dataviz #analytics #ai pic.twitter.com/L3gulpMeE7The power of storytelling with #data Source:100people
#dataviz #analytics #ai -
Cluster Configuration Best Practices for MLOps Workloads
By
–
Dive into best practices and tips on how to choose the best cluster configuration for sophisticated #MLOps workloads. This technical walkthrough discusses:
– Cluster sizing
– Single node vs multi-node
– When to use Databricks Pools
– And more https://
dbricks.co/3WYlMYl -
Docker Setup Tutorial for LLMs: Last Resort Option Due to Overhead
By
–
There's a tutorial for that as well: https://
github.com/rasbt/LLMs-fro
m-scratch/tree/main/setup/03_optional-docker-environment
…
But I would only consider that as the last resort because it adds overhead and is not very resource efficient. -
DevContainers Setup Guide and Local Machine Execution Preferences
By
–
There's a setup guide for DevContainers here, too: https://
github.com/rasbt/LLMs-fro
m-scratch/tree/main/setup/03_optional-docker-environment
…
No offense, but personally I had running it on my local machine. It has slower startup times, adds overhead, and is also storage-inefficient. -
Comparing Energy Consumption: Video Streaming vs AI Model Inference
By
–
Watching 20 min of a 4k video on YT is ~0.5 kWh Running 1000 Llama 3 8B prompts on a MacBook Pro: ~0.0025 kWh Running 1000 GPT 4o prompts: ?
-
Perplexity’s Deep Research free model rivals OpenAI’s $200 plan
By
–
Perplexity's Deep Research is now the best free model you can use – if you were curious about OpenAI's $200/mo plan for deep research, give this a try first – especially if you're just tooling around. Insanely comprehensive.
