A few new CUDA hacker friends joined the effort and now llm.c is only 2X slower than PyTorch (fp32, forward pass) compared to 4 days ago, when it was at 4.2X slower The biggest improvements were:
– turn on TF32 (NVIDIA TensorFLoat-32) instead of FP32 for matmuls. This is a
SOFTWARE
-
llm.c Performance Optimization: Closing Gap with PyTorch
By
–
-
v1.6.5 release: GPT-4 Turbo, Gemini 1.5, Command-R support
By
–
Quick minor release v1.6.5, supporting: GPT 4-Turbo Gemini 1.5-pro-latest Cohere Command-R We'll be adding support for images/videos upload for Gemini, and function calling with Anthropic Claude3 soon! Back to building
-
Canceling ChatGPT subscription to switch to HuggingChat
By
–
My ChatGPT subscription > Cancel > switch to HuggingChat only.
-
AI Builds Websites and Tools Without Coding Skills
By
–
I haven’t been using it for deep coding as I am not coder, but it builds cool little working websites and tools for me all the time. It is slow, but I find it quite capable, if limited by GPT-4 brains.
-
AI Large Language Models Transform Quick-Service Restaurant Customer Experience
By
–
#AI is helping quick-service restaurants (QSRs) enhance the customer service experience with large language models. Explore how the industry uses AI to increase customer satisfaction and revenue growth. https://t.co/VKfeORkDOv pic.twitter.com/91peVMlMGE
— NVIDIA AI (@NVIDIAAI) 12 avril 2024#AI is helping quick-service restaurants (QSRs) enhance the customer service experience with large language models. Explore how the industry uses AI to increase customer satisfaction and revenue growth. https://
nvda.ws/4aT8HEm -
The Satisfaction of Iterative Code Improvement and Optimization
By
–
there’s a very specific satisfaction in working diligently on the same code for a long while; every day I fix something small that irritates me, or add a metric that is useful every once in awhile, or make a certain piece just a bit faster over time these micro-optimizations
-
LangSmith Achieves SOC2 Type 1 Certification for LLM Development
By
–
We're excited to announce that LangSmith — our solution for LLM application development, monitoring, and testing — has now received SOC2 Type 1 Certification. After a rigorous audit process, LangSmith has been certified to conform to industry best-practices for the protection of
-
Claude 3 Opus now available on Google Cloud Vertex AI
By
–
Claude 3 Opus, our most capable model for highly complex tasks, is now in public preview on @googlecloud
's Vertex AI. The addition of Opus means businesses can optimize intelligence, speed, and cost across the full Claude 3 model family. Get started: https://
cloud.google.com/vertex-ai -
Legal Tech Sector Set to Exceed $45B by 2030 with GenAI
By
–
Poised to exceed $45 billion by 2030, the legal tech sector is rapidly leveraging the value of GenAI with retrieval-augmented generation (RAG). From redefining efficiency across research, document management, horizon scanning, and more to innovations in multilingual applications