In the Lex Fridman interview, he seemed to think GPT-4 may be a very early version of AGI. So if there are capabilities they are holding back (which is very likely), it’s possible he believes they are way closer than most would know.
AI
-
Measuring Digital Twin ROI: Key Performance Indicators for Success
By
–
How do you measure the #ROI of #digitaltwin technology? Bry Dillion from @AVEVAGroup explains how they evaluate the effectiveness of a digital twin & the key performance indicators they use to measure success. https://t.co/I1MLX6HLhv #se_iiot #digitaltransformation @GregorianCT1 pic.twitter.com/1pjMYIptHA
— Lucian Fogoros (@fogoros) 16 mai 2023How do you measure the #ROI of #digitaltwin technology? Bry Dillion from @AVEVAGroup explains how they evaluate the effectiveness of a digital twin & the key performance indicators they use to measure success. http://
ow.ly/uGM950Op5Jg #se_iiot #digitaltransformation @GregorianCT1 -
LLMs and Human Language: A Profound Insight from Stanford Research
By
–
Clever @google
/
@stanford paper on LLMs from my brother @jerryweiAI
. Performance boosts are great, but there is a more profound insight in this paper that was not explicitly stated: LLMs are trained on human language, but due to the nature of how language was developed (first -
Difficulty Creating ASCII Art, Cow-Like Result
By
–
I can never get it to make ascii art. At least that kind of looks like a cow?
-
Together Compute Raises $20M to Overcome Transformer Limitations
By
–
I spoke with @togethercompute which is exploring some new techniques to get past the Transformer wall. Together raised a $20m seed from Lux Capital and is also responsible for the RedPajamas open source dataset replicating LLaMA’s set.
-
Alteryx Inspire Conference Las Vegas Registration and Top Sessions
By
–
Register at http://
bit.ly/41giHTe for the @Alteryx Inspire Conference in Las Vegas! Top 10 Sessions to Attend: https://
alteryx.com/input/blog/the
-10-top-sessions-to-attend-at-inspire-2023
… — @Alteryx is the Leader in Self-service #DataAnalytics Automation: https://
alteryx.com/alteryx-analyt
ics-automation-platform
…
———
#BigData #DataScience #AI #MachineLearning -
MegaByte: Meta’s Latest Context Window Expansion Breakthrough
By
–
Finally a third one that is super recent is MegaByte, a paper coming out of Meta last week. This one has been getting a lot of buzz. The three approaches are attempts to expand the context window, which allows for more information coming in (and broader hidden prompts).
-
Sub-Quadratic Attention Techniques: FlashAttention and Hyena Advances
By
–
There are a few new techniques under review right now that try to get sub-quadratic attention. The most common one I hear about today is FlashAttention, which evolves the technique to increase the context window. Hyena out of Stanford’s Hazy lab explores convolutional approaches.
-
Context Window Limitations Restrict Advanced AI Model Capabilities
By
–
Some of that has to do with restrictions around context windows, which govern how much information can go into and come out of a prompt. Right now those windows generally fall in the 4k to 8k token range. Already that is showing signs of being insufficient for advanced uses.
-
Beyond Transformers: The Next Frontier in AI
By
–
Today’s issue of supervised covers the hunt for what comes after Transformers. That technique, pioneered by Google, has made modern AI possible—but many consider us hitting the “wall” so to speak.