This was designed to be a very hard test for AIs, and the questions were kept private, lowering the chance they were in the training data. PhDs with access to the internet got 34% of the questions right outside their specialty, 65%-75% inside. The new Claude 3 gets 60% overall.
AI
-

Claude 3 Tokenization Challenge: Stylistic but Contains Subtle Hallucinations
By
–
Claude 3 takes on the Tokenization book chapter challenge π context: https://t.co/yRaeTbkblY
— Andrej Karpathy (@karpathy) 4 mars 2024
Definitely looks quite nice, stylistically!
If you look closer there are a number of subtle issues / hallucinations. One example there is a claim that "hello world" tokenizes into 3β¦ https://t.co/mMjK27Uk2yClaude 3 takes on the Tokenization book chapter challenge π context: https://
x.com/karpathy/statu
s/1760740503614836917
β¦ Definitely looks quite nice, stylistically! If you look closer there are a number of subtle issues / hallucinations. One example there is a claim that "hello world" tokenizes into 3 -

Grayskull TT-Metallium Quick Start Guide for Hardware Optimization
By
–
Once you purchase and install Grayskull, we created a list of the first 5 things we recommend trying with TT-Metallium to familiarize yourself with the available tools for optimizing performance on #tenstorrent hardware. These can be found in the quick start guide of our Github.
-
Join Tenstorrent Discord Grayskull Community for Developers
By
–
You can also join the Tenstorrent Discord to chat directly with the Grayskull community, see what other developers are building, and get help from the Tenstorrent team.
-
Grayskull Dev Kit and TT-Metallium Stack for AI Customization
By
–
The Grayskull Dev Kit and TT-Metallium stack are great for developers who want to customize their models, write new ones or even run non-machine learning code. Learn more about TT-Metallium on our Github.
-
Grayskull Dev Kit AI Hardware Launch Announcement
By
–
Today we are officially launching our Grayskull Dev Kit, available for purchase on our website. This is our 1st gen AI PCIe card – an inference-only hardware kit we are releasing alongside TT-Metallium – our open source software stack.
-

Query Analysis Techniques for RAG Systems Optimization
By
–
Query Analysis What do the following methods have in common? StepBack Prompting
HyDE
Query Structure They are all examples of **query analysis**, a technique to optimize queries to a RAG system We've added a brand new docs section on this! https://
python.langchain.com/docs/use_cases
/query_analysis/
β¦ -

DataRobot Celebrates Women in AI History Month
By
–
Happy #WomensHistoryMonth! Weβre proud to celebrate the amazing women of DataRobot
-
GitHub Introduces Multiple README Files Feature
By
–
github lets you have multiple READMEs now. actually a really nice new feature pic.twitter.com/Jty2jhorVO
— dr. jack morris (@jxmnop) 4 mars 2024github lets you have multiple READMEs now. actually a really nice new feature
-

SAS Innovate Conference: AI, Technology and Networking April 16-19
By
–
Inspiring keynotes, the latest in tech and AI, ample networking + more at #SASInnnovate Register to join us and your peers in Vegas, April 16-19!
