This is an Yi-34B fine-tune, which does very well on Chinese evals and is trained on lots of Chinese text. It's created by a Chinese company.
RESEARCH
-
Awaiting Details on OpenAI Internal Developments and Changes
By
–
Patiently waiting for the @CadeMetz drop on what actually happened at OpenAI. pic.twitter.com/NnvRL0CrVs
— Paul Roetzer (@paulroetzer) 18 novembre 2023Patiently waiting for the @CadeMetz drop on what actually happened at OpenAI.
-
Twitter followers don’t predict long-term tech influence
By
–
well, you left out the “as of now” I think my main point is that Twitter followers doesn’t really correlate with influence on the long-term arc of technological progress
-
Making History with LLMs and Generative Models
By
–
How to make history with LLMs & other generative models https://
leighmariebraswell.substack.com/p/how-to-make-
history-with-llms-and?utm_source=substack&utm_medium=email
…
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Mobile-Era CEO Culture Clashes With Traditional Scientific Research Pace
By
–
This is in a field filled with researchers accustomed to the deliberate and thoughtful (and slow) scientific progress. That classic mobile-era CEO, supercharged by ZIRP, focused on growth and global impact above else. And he’s been a Bay Area fixture for more than a decade.
-
OpenAI Structure Update June 2023 Details
By
–
And here are details on the OpenAI structure (updated June 2023) https://
openai.com/our-structure -
Complete Guide to Start and Improve Your LLM Skills in 2023
By
–
Good morning fellow AI enthusiast! This week's iteration focuses on a NEW complete guide to start and improve your LLM skills in 2023 without an advanced background in the field and stay up-to-date with the latest news and state-of-the-art techniques! https://
open.substack.com/pub/louisbouch
ard/p/start-and-improve-your-llm-skills?r=25qlky&utm_campaign=post&utm_medium=web
… -
Geoffrey Hinton’s Journey Inspires AI Research and Innovation
By
–
I enjoyed reading this interview with @geoffreyhinton
. As a side note, I loved the childhood and family pics, as well as reading about his touching personal journey, his challenges and hope. He has always been and will always be an inspiration for what I do. I’m grateful for it. -
Self-Supervised Learning for Planning: A Decades-Long Research Journey
By
–
I've been advocating for architectures that can plan using a world models trained Self-Supervised Learning for a very long time.
E.g. my NIPS 2016 keynote (below, 25 minutes in). I've been working on SSL from video since 2014. But, unlike others:
1. I've always said that deep -
OpenAI Safety and Responsible AI Development Concerns
By
–
Wishing safety and stability for all our research colleagues at @OpenAI
. I hope that on Monday you can all get back to your normal workflow of developing AI responsibly.