Check out OPT-IML, but a lot of people said they didn't know:
– Flan-T5 checkpoints are publicly available (without requesting access)
– Flan-T5 11B outperforms OPT-IML on MMLU and Big-Bench Hard, despite being 10x more compute efficient Checkpoints: https://
huggingface.co/docs/transform
ers/model_doc/flan-t5
…

→ View original post on X — @_jasonwei,