Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference A neural network module that dynamically adapts computational load per token, reducing inference costs without sacrificing accuracy. Problem: Transformer models are computationally
Adaptive Computation Modules: Efficient Token-Level Conditional Inference
By
–
