Also don't forget llama exists and weights are available all over the internet. It's illogical to build an LLM from scratch if your goal is build a Chatgpt competitor. Qlora exists to reduce compute costs. Cost argument is weak unless there's some need to reinvent the universe.

→ View original post on X — @waitin4agi_,