Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c: https://
github.com/karpathy/llm.c To start, implements GPT-2 training on CPU/fp32 in only ~1,000 lines of clean code. It compiles and runs instantly, and exactly
SOFTWARE
-
llm.c: Train GPT-2 in Pure C Without Heavy Dependencies
By
–
-
Serverless ChatGPT RAG with LangChain.js and Azure
By
–
🚀Serverless ChatGPT with RAG using LangChain.js
— LangChain (@LangChain) 8 avril 2024
Great OSS repo that shows how to build a serverless ChatGPT-like experience with Retrieval-Augmented Generation using LangChain.js and Azurehttps://t.co/Bh95rgu7Bb pic.twitter.com/UlLf38DKrbServerless ChatGPT with RAG using LangChain.js Great OSS repo that shows how to build a serverless ChatGPT-like experience with Retrieval-Augmented Generation using LangChain.js and Azure https://
github.com/Azure-Samples/
serverless-chat-langchainjs?tab=readme-ov-file
… -
Why Most Non-Tech Users Won’t Adopt Local AI Tools
By
–
For 99.9% of non-techies, no. Think of a person in your life who is completely outside of tech. Can you really see them downloading LMstudio, loading in models, etc.? The only real exception is if someone like Apple ships with the AI integrated. If the user has to think, fail.
-
Free Production-Level Code and MLOps Learning Course
By
–
A 100% free course to Learn How to Write Production level Code and learn MLOps This will teach you everything from Design, Modelling, Testing, Serving Machine Learning Models, and much more for free! 35k+ on Github http://
madewithml.com -
Companies Adopting LLMs as Documentation for Software Tools
By
–
I am waiting for the first companies to seriously adopt LLMs-as-documentation. Especially for software tools, they can get you remarkably far. https://t.co/EgBmm3bQvZ
— Ethan Mollick (@emollick) 8 avril 2024I am waiting for the first companies to seriously adopt LLMs-as-documentation. Especially for software tools, they can get you remarkably far.
-
Serverless Pricing Strategy: Cold Starts Impact Monthly Costs
By
–
That $1.94/month is for if you leave their 256MB instance running all month without any cold starts at all – if you let it scale to zero it will cost significantly less
-
Streaming massive AI systems outperforms local complex setups
By
–
Much more intensive/technical setup + worse capabilities = a losing proposition. We can stream the outputs from a massive AI system directly to a user… this is more than enough for the average person.
-
Understanding What Running Apps on Phones Really Means
By
–
The average person doesn’t understand what “running on your phone” means
-
Building RAG Chatbot with Azure OpenAI and LangChain.js
By
–
Building a RAG chat bot with Azure OpenAI and LangChain.js Another great article from Azure Developers JavaScript Day on building a RAG chatbot within the Azure ecosystem Comes with a blog post and video! blog: https://
techcommunity.microsoft.com/t5/microsoft-d
eveloper-community/building-a-rag-pattern-chat-bot-with-azure-openai-and-langchain/ba-p/4105727
… Video: https://
youtube.com/watch?v=4fNoGZ
STB_A
… -
Apple’s Latest Papers Generate Excitement for Upcoming WWDC
By
–
All these Apple papers have me insanely excited for WWDC