NVIDIA’s LLM vulnerability scanner, Garak, is an open-source tool equipped with generators, probes, and detectors that assess the robustness of an LLM and identify weaknesses across specific attack vectors Learn how to scan your Databricks-hosted LLM using the REST API,
CODE
-
JAX Code Execution on TPUs Without Low-Level Library Complexity
By
–
You can write JAX code and run it on top of TPUs (or CPUs or GPUs) without having to deal with low-level libraries.
-
Axolotl: YAML-Based Fine-Tuning Framework with Memory Optimization
By
–
4. Axolotl • Yaml-based setup for fine-tuning, LoRA/QLoRA, DPO, GRPO, and multimodal workflows
• Includes kernel optimizations for memory-efficient training GitHub repo → -
DeepSpeed: Distributed Fine-tuning Framework for Large-Scale LLM Training
By
–
3. DeepSpeed • Built for large-scale distributed fine-tuning with ZeRO and FSDP
• Optimized for multi-GPU and multi-node training with advanced memory management
• Trusted in production environments for scalable LLM training GitHub repo → -
Four Open-Source Libraries to Accelerate LLM Fine-Tuning
By
–
4 libraries that accelerates fine-tuning of LLMs (100% open-source)
-
Timing Build Derivation from Commit History Analysis
By
–
You can derive the timing of the build from the commit history https://
github.com/simonw/system-
exploration-g/commits/main/
… -
GitHub Docs: Building AI Tools with Exact Prompts
By
–
… I linked to mine in the blog post, and included the exact prompts I used to build it https://
github-spark-docs.simonwillison.net -
Comparison of AI-powered development tools for builders
By
–
Most devs are chasing GitHub Spark. Builders are using this.
-
Meta and Partners Launch Papers with Code Successor Platform
By
–
BREAKING: we've partnered with @metaai and @paperswithcode to build a successor to Papers with Code (which was sunsetted yesterday) PWC, founded by @rbstojnic and @rosstaylor90 has been an invaluable resource for AI scientists and engineers over the years (and an inspiration