AI - AI Dynamics

→ View original post on X — @alexandr_wang

Great Builders Ask Right Questions Focus Problems

By

@alexandr_wang

–

09 July 2023 20h50

what sets great builders apart is not that they are smarter [lots of people are smart], or even that they’re better at building it’s that they ask the right questions and focus on the right problems how do you get good at this? practice genuine, deep curiosity

Focusing on Improving Modeling Performance Over Computational Performance

By

–

09 July 2023 20h37

*the focus here is on improving modeling performance, not computational performance.

Position Interpolation Extends RoPE Context Windows to 32K Tokens

By

–

09 July 2023 20h33

Rotary positional embeddings (aka RoPE) have been a recent cornerstone of modern LLM implementations since it supports flexible sequence lengths. In this paper, researchers propose Position Interpolation to increase RoPE-based context window sizes to 32,768 tokens 2/3

Humble approach to long context lengths with minimal finetuning

By

–

09 July 2023 20h33

This sounds a bit more humble than the recent 1M or 1B context lengths claims. But this requires only minimal (1000 steps) finetuning. And it allows long document summarization using LLaMA 7B and 65B models, for example. Link to the paper here: https://
arxiv.org/abs/2306.15595 3/3

Extending Transformer LLMs Context Window via Positional Interpolation

By

–

09 July 2023 20h33

In the last couple of days, we talked a lot about extending the context window of transformer LLMs. Here's one more: "Extending Context Window of Large Language Models via Positional Interpolation" 1/3

→ View original post on X — @waitin4agi_

Celebrity PR boosts competitor launch in tech rivalry

By

@waitin4agi_

–

09 July 2023 20h01

watching the worlds biggest celeb give free PR to the man who just happened to launch a competitor

→ View original post on X — @terence_mills

AI Democratizes Healthcare by Providing Everyone Access to Best Doctors

By

@terence_mills

–

09 July 2023 20h01

How To Democratize Healthcare: AI Gives Everyone The Very Best Doctor
#AI #AIio #BigData #ML #NLU #Futureofwork @TunstallAsc @StrategyFintech @TamaraMcCleary @TerenceLeungSF @psb_dc @thomaspower @vinod1975 @ylecun http://
ow.ly/8VTC30sw8oT