LLMS

→ View original post on X — @baiduresearch

Baidu releases 11 new ERNIE models across general and industry sectors

By

@baiduresearch

–

05 December 2022 17h09

The newly released 11 models are added to the Big Model ERNIE family:
– 5 general models: ERNIE 3.0 Tiny, ERNIE ViL 2.0, ERNIE ViLG 2.0, ERNIE-Layout, HelixFold-Single
– 1 task model: ERNIE-Code
– 5 industry models created by Baidu & Shenzhen Gas, Geely, Taikang, TCL, and Cihai

→ View original post on X — @baiduresearch

Baidu Releases 11 New AI Models at Wave Summit

By

@baiduresearch

–

05 December 2022 17h09

At Wave Summit+ last week, Baidu released a wave of new AI technologies to drive AI adoption and further lower the threshold.
– 11 new AI Big Models – PaddlePaddle 2.4
– New features of AI-generated art platform
– A neural search system
Read more: http://
research.baidu.com/Blog/index-vie
w?id=174
…

ChatGPT removes similar strings, suggesting hidden control codes

By

–

05 December 2022 16h15

The fact that ChatGPT removes not just this string, but any string formatted similarly, suggests there exist other control codes by ChatGPT, e.g. to mark the boundaries between user input and prior model output within the prompt context.

The string ” represents end of generation in GPT-3 tokenizer

By

–

05 December 2022 16h14

The string “” is handled specially by GPT-3’s tokenizer to represent the end of a generation. Whenever this token is emitted, the model stops talking immediately:

ChatGPT silently removes empty quote substrings from input

By

–

05 December 2022 16h14

A demonstration that ChatGPT silently removes from user input all substrings of form “” where “foobar” is any single word without whitespace:

Tokenization issue in counting letters of word ‘elementary’

By

–

05 December 2022 15h28

Yes. The correct response to: How many letters are in “elementary”? …really should be: Due to tokenization issues you can read about [here], I need to count these letters one at a time: e1-l2-e3-m4-e5-n6-t7-a8-r9-y10. Thus we see ‘elementary’ has 10 letters.

→ View original post on X — @swyx

Simulating Reality: LLMs and the Simulation Hypothesis Question

By

@swyx

–

05 December 2022 15h20

The reason that emulating virtual machines, chatrooms, and APIs inside large language models is exciting, isn’t just because “haha cool nerd stuff”. It means we are that much closer to simulating all of our world in it. And if we can do it… how would we know we aren’t in one?