And yet they can be conditioned to be boring and non controversial through RLHF.
LLMS
-
Genome-Scale Language Models Learn SARS-CoV-2 Evolutionary Landscape
By
–
Tomorrow @argonne
's Arvind Ramanathan shares with our community how his team built genome-scale language models that can learn the evolutionary landscape of SARS-CoV-2 genomes. This research won the 2022 ACM Gordon Bell Special Prize. Join us! https://
hubs.li/Q01CV9rF0 -
GPT Implementation in 60 Lines of NumPy and JAX
By
–
Late to the party but "GPT in 60 Lines of NumPy" / picoGPT is nicely done: https://
jaykmody.com/blog/gpt-from-
scratch/
…
– good supporting links/pointers
– flexes some of the benefits of JAX: 1) trivial to port numpy -> jax.numpy, 2) get gradients, 3) batch with jax.vmap
– inferences gpt-2 checkpoints -
French Government Misunderstands ChatGPT Revolution, Minister Criticizes
By
–
Au moment où la France devrait faire un immense effort pour ne pas être écrabouillée dans la course à l’IA… Le gouvernement ne comprend pas la RÉVOLUTION CHATGPT "Un perroquet approximatif": le ministre du Numérique tacle ChatGPT
-
Andrej Karpathy discontinues arxiv-sanity maintenance
By
–
Sad but I just don't have the time to maintain it anymore. It's possible I'll try to build yet another version of a more LLM-powered arxiv-sanity, I have a few ideas there. For now it is what it is sorry. Please refer to:
1 https://
papers.labml.ai/papers/weekly
2 https://
paperswithcode.com -
ChatGPT language bias: English accurate, Portuguese misleading
By
–
A subtler example: Telmo Gomes, an IoT expert, found that while ChatGPT gave him great answers in English, it gave completely misleading ones to the same question in Portuguese. Importantly, with his existing knowledge, he could identify which ones to consider or discard.
-
Energy Transformer: Replacing Feedforward Blocks with Associate Memory
By
–
10). Energy Transformer – a transformer architecture that replaces the sequence of feedforward transformer blocks with a single large Associate Memory model; this follows the popularity that Hopfield Networks have gained in the field of ML.
-
Augmented Language Models: Reasoning Skills and Tool Integration Survey
By
–
7). Augmented Language Models – a survey of language models that are augmented with reasoning skills and the capability to use tools.
-
Auditing Large Language Models: Policy Framework Proposal
By
–
9) Auditing large language models – proposes a policy framework for auditing LLMs.