That doesn't work for anything with non-persistent buffers (which is most current LLMs AFAICT, since the sin/cos cache is in those buffers)
COMPUTING
-
HuggingFace Model Quantization on 24GB GPU
By
–
I used HuggingFace and quantized the model to 4 bits, I believe it ran on a 24GB gpu (maybe need 48)
-
Renewable Energy Efficiency Technology Solutions
By
–
One Technology That Makes Renewable Energy More Efficient >> https://
ow.ly/izEX50Q6pwi #sponsored #influxdata_iiot #InfluxDB #digitaltransformation #energyefficiency #TimeSeries #awsreinvent #reinvent23 #reinvent -
The Permanent Nature of Saved Code Work
By
–
Something that made a large impression on me when I started coding — each day when you're done working, you just save your work & it's there forever. Very unlike building something physical where your artifact can break, or math where daily progress is usually your mental state.
-
Art Meets Computing: Exploring Creative Technology Intersections
By
–
I like art and computers (just not n that order!). Ha!
-
Code Determinism Makes Programming Fundamentally Easy
By
–
Code is easy for the same reason chess is easy: it's deterministic, and the effects are fully observable.
-
97% of Organizations Struggle Securing IoT Connected Devices
By
–
New Report Reveals 97% of Organizations Face Challenges Securing IoT and Connected Devices
>> https://
ow.ly/VNPs50Q4eHn #sponsored #keyfactor_ics #cybersecurity #iotsecurity #IoT #PKI #cybercommunity #Keyfactor @FogorosR @ChuckDBrooks @Fabriziobustama via @fogoros -
4096 Bit Floats: Advanced Computing Technology Innovation
By
–
shhhh, this was gonna be how i won the bet, 4096 bit floats
-
Neural Networks Optimize Industrial Sensor Data Processing
By
–
Sensor Raw Data Pre-Processing with Neural Networks Saves a Fortune! https://
ow.ly/zS0y50Q5ZcS #sponsored #polyn_iiot #digitaltransformation #iiot #AI #industry40 #sensor #sensortechnology #artificialintelligence @FogorosAndrei @CRudinschi via @fogoros -
Databricks Azure Confidential Computing Data Platform GA
By
–
Build an end-to-end data platform with confidentiality and privacy on Databricks with Azure confidential computing support! Now GA, take a look at the advantages of this integration and its key features https://
bit.ly/40Kx972