NVIDIA’s LLM vulnerability scanner, Garak, is an open-source tool equipped with generators, probes, and detectors that assess the robustness of an LLM and identify weaknesses across specific attack vectors Learn how to scan your Databricks-hosted LLM using the REST API,
OPEN SOURCE
-
Open-source AI leads innovation despite resource disadvantages
By
–
When you realize that open-source is at the frontier of AI despite:
– less GPUs
– less money
– less public and policy support
– no $100M salaries to attract talent
– with closed-source taking advantage and copying all the innovations of open-source without contributing back -
Montreal AI Releases AGI Alpha Agent v0 Open Source
By
–
[ “We Choose to Ascend with AGI” ] Together, we choose not merely to witness the dawn of AGI, but to ascend with it. GitHub : https://
github.com/MontrealAI/AGI
-Alpha-Agent-v0
… #AGIALPHA -
JAX Code Execution on TPUs Without Low-Level Library Complexity
By
–
You can write JAX code and run it on top of TPUs (or CPUs or GPUs) without having to deal with low-level libraries.
-
Axolotl: YAML-Based Fine-Tuning Framework with Memory Optimization
By
–
4. Axolotl • Yaml-based setup for fine-tuning, LoRA/QLoRA, DPO, GRPO, and multimodal workflows
• Includes kernel optimizations for memory-efficient training GitHub repo → -
LLaMA Factory: Fine-tune 100+ Models with LoRA and QLoRA
By
–
2. LLaMA Factory • Fine-tune over 100 models (LLaMA, Mistral, Gemma, etc.) using a simple CLI or WebUI
• Supports LoRA, QLoRA, full or frozen fine-tuning across 2–8‑bit precision GitHub repo → -
DeepSpeed: Distributed Fine-tuning Framework for Large-Scale LLM Training
By
–
3. DeepSpeed • Built for large-scale distributed fine-tuning with ZeRO and FSDP
• Optimized for multi-GPU and multi-node training with advanced memory management
• Trusted in production environments for scalable LLM training GitHub repo → -
Unsloth AI: Fine-tune LLMs 2× faster with 70% less VRAM
By
–
1. Unsloth AI • Fine-tune models like Qwen3, Llama 4, and Gemma 3 up to 2× faster with 70% less VRAM
• Supports low-resource setups and runs on consumer GPUs or even Colab/Kaggle with ~3 GB VRAM GitHub repo → -
Four Open-Source Libraries to Accelerate LLM Fine-Tuning
By
–
4 libraries that accelerates fine-tuning of LLMs (100% open-source)