Excited to share our latest case study on Verb, a new AI writing tool powered by AI21 Studio! With the use of our custom models, Verb goes beyond mere text generation and becomes a true partner to authors everywhere.
LLMS
-
Bard announcement based on LaMDA for natural dialogue testing
By
–
And one of the best ways to interact with these models is of course through dialogue. And hence the announcement of Bard built on LaMDA to interact naturally. Currently Bard is being tested with internal and external people.
-
New Audio Speech Model Announcement Expected Today
By
–
A little bird told me that @mhollemans might be announcing a very cool audio/ speech model today! Stay tuned..
-
Language Models Near AGI: Missing Autonomy and Multimodal Integration
By
–
Jazykovy model je uz take male AGI. Dobre rozumie nasmu svetu, vie riesit problemy atd. Co mu chyba (da sa doplnit) je autonomia, schopnost sa ucit zo skusenosti, dalsie modality (video, real fyzika), schopnost pouzivat externe nastroje, komunikacia s inymi jazykovymi modelmi.
-
DAGGER vs RL: Feedback Methods for LLM Training
By
–
While DAGGER is a great idea to enable Feedback for LLMs (eg chat) it is not a replacement for RL because RL opens up room for different forms of feedback (eg preferences). However, as a teacher I would advise careful measurement of the contribution of each to the final metric.
-
DAGGER Counterfactual Teaching Method for LLM Training
By
–
DAGGER is a form of counterfactual teaching as explained in https://
arxiv.org/abs/2110.10819 – Note that it is the student who always acts. The teacher only provides corrections, which are used to minimise the LLM loss directly. Note however that this imitation IS NOT supervised learning. -
DAGGER: Imitation Learning Alternative to Reinforcement Learning
By
–
People are asking if there are alternatives to RL in RLHF. Yes, imitation with DAGGER (tutorial: https://
ri.cmu.edu/publications/a
n-invitation-to-imitation/
… ). The user provides feedback with corrections, e.g. when the agent says “that” the user tells the agent that instead of saying “that”, it should say “this”. -
ChatGPT future predictions confirmed one week later insights
By
–
En el directo de la semana pasada nos preguntamos cómo sería el futuro de herramientas como ChatGPT y ya 7 días después algunas cosas se han demostrado ciertas. Hay info super relevante para entender lo que va a venir
-
AI Summarization with Citations: Beyond ChatGPT Capabilities
By
–
5. Summarize and simplify things on-the-fly! Input: Write a summary of the history of Rome suitable for a 10 year old. Unlike ChatGPT, it also has citations for the generated response.
-
AI Hallucination Issues in Language Models
By
–
Pretty good, although that had pre-existing context that I was asking about Stratechery. A fresh query inserted some stuff that I didn't say (i.e. the last paragraph is hallucinated)