Update: But not for logprobs. Paper published today by @maksym_andr reports logprobs returned from OAI API are non-deterministic even with the seed parameter. Not sure how to reconcile this with sampled completions described as deterministic.
Paper Reports Non-Deterministic Logprobs from OAI API Despite Seed Parameter
By
–
