Scalable Autoregressive Image Generation with Mamba discuss: https://
huggingface.co/papers/2408.12
245
… model: https://
huggingface.co/hp-l33/aim We introduce AiM, an autoregressive (AR) image generative model based on Mamba architecture. AiM employs Mamba, a novel state-space model characterized by its
OPEN SOURCE
-
Scalable Autoregressive Image Generation with Mamba Architecture
By
–
-
ExpertsInt8 Quantization Enables Jamba 1.5 Large on Single Node
By
–
To make sure Jamba 1.5 Large fits a single node, we developed ExpertsInt8, a quantization technique for MoE models. We are now able to fit the model with its entire 256K context window on a single node, without losing quality or having a complicated quantization process. [6/6]
-
Jamba 1.5 Models: Hybrid SSM-Transformer Architecture Innovation
By
–
The Jamba 1.5 models are based on our novel hybrid SSM-Transformer architecture, which combines the quality, speed and efficiency of both. Jamba 1.5 Mini has 12B active/52B total parameters, while Large is 94B active/398B total – the largest Mamba model ever made. [2/6]
-
Conda Alternatives for Managing PyTorch and DeepSpeed Dependencies
By
–
please suggest conda alternatives. needs to manage torch, deepspeed, etc without fuss.
-
Jamba 1.5 Mini and Large Models Released on Hugging Face
By
–
Jamba 1.5 Mini and Large on Hugging Face: https://
huggingface.co/collections/ai
21labs/jamba-15-66c44befa474a917fcf55251
… -
5 Hugging Face Tools to Boost AI Builder Productivity
By
–
Hugging Face has taken the AI ecosystem by storm but most people still use it wrong. Here's 5 tools to boost your AI builder productivity by 166x: https://
huggingface.co/blog/unsung-he
roes
… -
Google Vizier: Open Source Black Box Optimization Tool
By
–
Vizier is a tool used in tens of thousands of places at Google for a huge variety of different black box optimization tasks, including hyperparameter search. Especially for high dimensional problems, it's dramatically better than other solutions. There's an open source version!
-
Facebook AI Tool Closed Source and Hackable Issues
By
–
I seen the FB one and that at least was hackable. Closed source and buggy is
-
Code Release Coming Soon on GitHub
By
–
Ugh no I don’t care about moneys. It’s gonna land on GitHub eventually.
-
Learning to code without frameworks raw approach
By
–
Raw dogging it for now. Wanna learn not use frameworks.