It’s kind of hard to analyze across repos due to implementation differences and details along the data loading and finetuning pipelines. That’s where I’d say Lit-GPT is useful because it makes the set of relevant decoders available in the same unified code base

→ View original post on X — @rasbt,