I got Bing / Sydney briefly before they reigned it in. Early impression: It’s smart. Much smarter than prior ChatGPT. Still makes stuff up, but reasoning and writing are improving fast.
@goodside
-
Bing/Sydney Impressive, but Frequent Offline Issues Suggest Scaling Problems
By
–
Just been busy — overall very impressed by Bing / Sydney. Need to find time to post examples but it's been frequently offline, presumably scaling issues.
-
Riffing on preamble topic vs simple Q/A prompt
By
–
I think it’s just riffing on the topic of the preamble. Does it do this with a simpler prompt like “Q:”/“A:”?
-
Bing’s Chained Search Lookups: An Illustrative Example
By
–
Example illustrating Bing's apparent ability to do chained sequences of search lookups:
-
Skepticism about prompt vs human-written policy in ChatGPT RLHF
By
–
Thought about this more: It doesn’t make sense it’s the prompt, because inference costs. Still feels human-written — but why would you RLHF into reciting all policy verbatim? ChatGPT falls for the same trick and the text it recites is just parameters.
-
Bing Search correctly explains SolidGoldMagikarp GPT glitch
By
–
This one is impressive on a few levels — Bing Search gives a mostly correct answer explaining the "SolidGoldMagikarp" glitch, a recently discovered issue in which prior GPT models (incl. ChatGPT) cannot repeat back certain short strings:
-
Contrasting Bing Search and ChatGPT responses to mistaken math proof request
By
–
An example contrasting Bing Search and ChatGPT responses to a mistaken request for a math proof:
-
Testing repetition of anomalous tokens in LLMs
By
–
How does it do with repetition of other anomalous tokens?
