Tiktoken improvements Thanks to @jamescalam you can now specify `allowed_special` and `disallowed_special` as parameters for the tiktoken tokenizer PR: https://
github.com/hwchase17/lang
chain/pull/924
…

→ View original post on X — @langchain,