If you want to look under the hood at the actual custom CUDA kernels and see exactly how we implemented the TwELL format for H100 GPUs, we’ve released the reference code. GitHub: https://
github.com/SakanaAI/spars
er-faster-llms
…
Blog: https://
pub.sakana.ai/sparser-faster
-llms/
…
Custom CUDA Kernels for TwELL Format on H100 GPUs Released
By
–
