We’re excited to see you at @NVIDIAGTC this month! Don’t miss a hands-on session with practitioners from DataRobot and @nvidia exploring inference and monitoring capabilities designed for #LLMs to build highly-performant, enterprise-grade AI solutions. Stop by booth #1603 to
SOFTWARE
-
PyTorch Releases GPT-Fast for Efficient Text Generation
By
–
Pytorch released GPT-fast!⚡️
— Sumanth (@Sumanth_077) 5 mars 2024
This is a simple and efficient implementation of pytorch-native transformer text generation:
Here are some key features:
– Very low latency
– <1000 lines of python
– No dependencies other than PyTorch and sentencepiece
– int8/int4 quantization
-… pic.twitter.com/chk4ms5nf6Pytorch released GPT-fast! This is a simple and efficient implementation of pytorch-native transformer text generation: Here are some key features: – Very low latency
– <1000 lines of python
– No dependencies other than PyTorch and sentencepiece
– int8/int4 quantization
– -
PyTorch Profiler Tutorial Fix in Nightly Release
By
–
fwiw, i checked whether this tutorial was working on the PyTorch Nightly (by running this script directly: https://
raw.githubusercontent.com/pytorch/tutori
als/main/recipes_source/recipes/profiler_recipe.py
… )
and on the Nightly, this seem to have been fixed.
So it was either fixed in 2.1/2.2; or it'll be fixed in the next release. -
IoT Data Analytics with Python and Streaming Data Techniques
By
–
IoT Data #Analytics using #Python: http://
amzn.to/48hbaGM +
See my #IoT Streaming #DataAnalytics article here: https://
medium.com/@kirk.borne/ho
w-iot-streaming-data-is-going-to-the-dogs-e485fc4a782c
…
——————
#Coding #DataScience #DataScientists #AI #AIoT #MachineLearning #IIoT #Edge #EdgeComputing #TimeSeries #PredictiveAnalytics #Industry40 -
ML and AI Technologies Now Available Directly in Web Browsers
By
–
“#ML / #AI in the browser” is a real thing. To learn more, you must see this #WebML / #WebAI newsletter from @jason_mayes …
-
Whisper Audio Transcription Tool for Podcast Processing
By
–
I don’t publish podcasts as it is specifically an audio product, but I would imagine Whisper or something similar would do the job
-
YouTube Channel Launching Hardware and Software Tutorials
By
–
You can find out YouTube channel here, we will be posting tutorials on both HW and SW here in the next few weeks –>
-
Grayskull TT-Metallium Quick Start Guide for Hardware Optimization
By
–
Once you purchase and install Grayskull, we created a list of the first 5 things we recommend trying with TT-Metallium to familiarize yourself with the available tools for optimizing performance on #tenstorrent hardware. These can be found in the quick start guide of our Github.
-
Grayskull Dev Kit and TT-Metallium Stack for AI Customization
By
–
The Grayskull Dev Kit and TT-Metallium stack are great for developers who want to customize their models, write new ones or even run non-machine learning code. Learn more about TT-Metallium on our Github.
-
Grayskull Dev Kit AI Hardware Launch Announcement
By
–
Today we are officially launching our Grayskull Dev Kit, available for purchase on our website. This is our 1st gen AI PCIe card – an inference-only hardware kit we are releasing alongside TT-Metallium – our open source software stack.