RESEARCH

→ View original post on X — @wellingmax

Training Costs for Large Deep Learning Models Rising Significantly

By

@wellingmax

–

13 January 2023 20h15

I also made this prediction, which I still think will soon kick in, as the cost of training modern very large deep models is getting pretty high…

→ View original post on X — @wellingmax

AI Models Approaching 100 Trillion Parameters Ahead of Schedule

By

@wellingmax

–

13 January 2023 20h13

In my 2018 keynote at ICML I showed this curve and predicted that in 2025 we would have models with 100 trillion parameters. We might get there sooner…

→ View original post on X — @thatroblennon

GPT-2 Development Finally Showing Results and Success

By

@thatroblennon

–

13 January 2023 20h07

Finally all that tinkering since GPT-2 is paying off

TMLR Launches Expert Certification and Conference Partnerships for 2023

By

–

13 January 2023 19h01

For 2023:
– TMLR's Expert Certification reviewers will be selected
– An Outstanding Certification will be made
– Partnerships to present TMLR papers at specific conferences (AutoML, CoLLAs, and maybe even ICLR)
– Going beyond PDFs for papers! 7/7

OpenReview engineers advance community research infrastructure platform

By

–

13 January 2023 19h01

There's been some awesome work by @openreviewnet engineers, particularly @melisabok and Celeste Martinez Gomez, for adding some crucial functionality to OpenReview. So glad we have them and this awesome resource for the community! 6/n

Fast Conference Review Turnaround Accelerates AI Research Publication

By

–

13 January 2023 19h01

But I think the biggest news is just how *fast* the turnaround is. At ~75 days median, that's 2.5 months from submission to notification. The big conferences (NeurIPS, ICML, ICLR) are closer to 4 months. And much faster than JMLR, which takes > 200 days to first reviews. 5/n

TMLR releases first year operations report highlights

By

–

13 January 2023 19h01

TMLR (
@TmlrOrg
) just put out a report on their first (almost) year of operations. Here's a with some of the highlights. https://
docs.google.com/document/d/1tJ
Tw-LUJqENC5yxwmcTqlj4_Va1fWFqv7Lxt3eKMcqE/
… 1/n

TMLR publishes 188 papers with 62% acceptance rate

By

–

13 January 2023 19h01

TMLR numbers:
– 651 submissions
– 188 accepted papers
– currently ~100 submissions/month
– 189 action editors
– 1846 reviewers
– acceptance rate: 62% (46% if you count desk rejections and withdrawls)
– median time to decision: 76 days (#NeurIPS2022: 118 days, JMLR: >200 days) 2/n

→ View original post on X — @swyx

Choosing the Best Title for Google vs OpenAI Analysis

By

@swyx

–

13 January 2023 19h01

Need help deciding titles for my next piece on Google vs OpenAI! Ideas A: The Ultimate Guide to the Google vs OpenAI Debate
B: Every Google vs OpenAI Argument, Dissected
C: Should Sundar have ordered the Code Red?
D: Write in