The one downside I've seen from super long-context models like that is performance – my experiments with Gemini Pro 1.5 really long prompts has been that they can take 30-90s or more to return a response Also price: input is $7/1m tokens!

→ View original post on X — @simonw,