AI Dynamics

Global AI News Aggregator

Inference-Time Scaling: Prompt Modification vs Sampling and Verification

*One might argue that modifying prompts (eg classic "think step by step") counts as inference-time scaling due to the extra output tokens. So in that sense they use inference-time scaling.
I should have been more clear: I meant specifically sampling techniques + using a verifier.

→ View original post on X — @rasbt,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *