We’re thrilled to be MongoDB's AI App Framework Partner of the Year! LangChain is the #1 choice for developers building GenAI apps. We have immense gratitude for our community of over 2,000 contributors who have helped us shape the LLM application development space, and are
CODE
-
GPT-2 Training Code vs PyTorch’s Universal Capability
By
–
It's worth noting that this code specifically trains GPT-2.
PyTorch trains anything under the sun. -
Fused Classifier Kernel: Algorithmic Improvement Beyond Torch Compile
By
–
this is exactly what we're doing in the fused classifier kernel, and this is an *algorithmic* improvement on top of today's torch compile, which doesn't do this
-
cuBLASLt and cuDNN Dependencies for Optimized Performance
By
–
Yes, cuBLASLt for gemms, cuDNN for flash attention
The fp32 version will become more educational and will delete these dependencies. The "mainline" version we just want to be really fast, so we're less discriminating. cuBLASLt I think is ~ok dep, but cuDNN turned out surprisingly -
llm.c Day 24: Multi-GPU Training in C/CUDA Outperforms PyTorch
By
–
Day 24 of llm.c: we now do multi-GPU training, in bfloat16, with flash attention, directly in ~3000 lines of C/CUDA, and it is FAST! We're running ~7% faster than PyTorch nightly, with no asterisks, i.e. this baseline includes all modern & standard bells-and-whistles: mixed
-
Building the Fastest and Most Efficient Fine-Tuning Stack
By
–
What does it take to build the #fastest, most #efficient fine-tuning stack? We got answers! Join our deep dive to learn: Latest fine-tuning #optimization techniques Metric driven analysis of each optimization How to get started on your own https://
pbase.ai/3Wq2ATG -
Cohere Build Day Toronto: Knowledge Agents with Command R
By
–
Cohere Build Day is in Toronto! Follow us as we build knowledge agents with Command R and R+. This is your chance to share your projects, ask our team questions, and leave feedback.
-
SQLite-utils tool for extracting strings into lookup tables
By
–
I wrote a tool for pulling strings like that out into a lookup table https://
sqlite-utils.datasette.io/en/stable/cli.
html#cli-extract
… -
AI Agents: Rapid Creation and Deployment in Minutes
By
–
AI Agents will be very common and AI will build these agents. We can help AI build these agents. First we get the AI to create a first draft, review it, then quickly deploy it in production. All of this can be done as quickly as 5 min for simpler agents, while complex agents
-
LangChain Weekly Release: LangSmith Improvements and LangGraph Tutorials
By
–
LangChain Release Notes, Week of 4/29 Improved regression testing experience in LangSmith Hotkeys and mustache support in LangSmith New Evaluations content Three new video tutorials using LangGraph Community created content! Read it all here: