Smol models ftw! @AMD released AMD OLMo 1B – beats OpenELM, tiny llama on MT Bench, Alpaca Eval – Apache 2.0 licensed > Trained with 1.3 trillion (dolma 1.7) tokens on 16 nodes, each with 4 MI250 GPUs > Three checkpoints: – AMD OLMo 1B: Pre-trained model
– AMD OLMo 1B SFT:
AMD OLMo 1B: Efficient Open-Source Language Model Released
By
–
