(3) Even just looking at BIG-Bench metrics is quite understudied IMO. There are hundreds of tasks in BIG-Bench, and each task has dozens of models evaluated, each with many evaluation metrics. There are task logs for some models. This raises natural questions:
AI
-
Flan-T5 Public Release with Instruction Tuning Data Ablation
By
–
(2 cont.) Flan-t5 is publicly available along with the dataset (thanks to @ShayneRedford
), so you can even ablate parts of the instruction tuning data to see what unlocks performance. -
Unlocking emergent abilities in smaller language models like Flan-T5
By
–
(2) One key question of emergence is how to unlock such abilities at smaller scales, and I don't think there has been much work on flan-T5, which often beats PaLM 62B as shown in this paper: https://
arxiv.org/abs/2210.11416 -
WIRED Fast Forward: AI Search Wars Begin
By
–
I am now writing the @WIRED Fast Forward newsletter. (I'm only a few years late to the trend). The first issue is about the AI search wars. You can see a preview and subscribe here:
-
MIT Creates Liquid Neural Networks Outperforming Convolutional Networks
By
–
MIT scientists created a new class of speedy “liquid” neural networks that can change underlying algorithms on the fly, sometimes outperforming convolutional neural nets: https://
bit.ly/3K0lLxv Image v/
@QuantaMagazine -
Space Engineers Launches New Miniatures Product Line
By
–
Rastko Stanojevic crash-testing Space Engineers miniatures before we launch this new product line.@SpaceEngineersG pic.twitter.com/kkAGs1lAbn
— Marek Rosa | European🇪🇺 | South African🇿🇦 (@marek_rosa) 9 février 2023Rastko Stanojevic crash-testing Space Engineers miniatures before we launch this new product line. @SpaceEngineersG
-
AI Field Sees Realistic Optimism About Future Opportunities
By
–
Thing that stands out about current AI buzz is an unfamiliar realistic optimism, about the field specifically and tech generally. Still very early days (and plenty of concerns!) for AI, but seems like people are sensing tremendous opportunities personally and for society.
-
LangChain Adds Data Loaders for Cloud Storage and Popular Platforms
By
–
We added a lot of data loaders over the past few days: Cloud Storage: s3, GCS
Prosumer: Roam, Obsidian
Fun Websites: YouTube, AZLyrics, College Confidential https://
langchain.readthedocs.io/en/latest/modu
les/document_loaders/how_to_guides.html
… Which ones are you favorites? -
Magic Sandbox Project Reaches Hacker News Front Page
By
–
my "magic sandbox" makes the frontpage of hackernews never too old! https://
github.com/thomwolf/Magic
-Sand
… -
Open Assistant: Community-Driven Open Source ChatGPT Alternative
By
–
NEW VIDEO! Can you imagine an Open Source ChatGPT? Created by and for the community, available to create, research, and use freely. That's the idea behind Open Assistant! And we need your help to make it speak good SPANISH well https://
youtu.be/XYT1TxINbuM
—