Despite us all clamouring for larger token sizes on AI APIs, some of the real-world testing suggests the larger the amount of content fed to an LLM the more difficult it is to produce acceptable responses.

Find out about this & more by watching https://t.co/sLzgzpxyKJ pic.twitter.com/VwlU7ALAwq

— Replit ⠕ (@Replit) 28 mai 2023

Despite us all clamouring for larger token sizes on AI APIs, some of the real-world testing suggests the larger the amount of content fed to an LLM the more difficult it is to produce acceptable responses. Find out about this & more by watching https://
youtube.com/watch?v=zXX0I6
dOPYk
…

→ View original post on X — @replit,