Here is a good dive in on LLaMa underperforming on the EleutherAI harness versus the published number (TLDR is that we don't know yet which prompt they used for evaluation):
AI
-
ChatGPT Introduces Sharable Conversation Links for All Users
By
–
Covered: ChatGPT releases sharable links to all users. Check a shared link from TestingCatalog inside https://
testingcatalog.com/chatgpt-introd
uces-sharable-links-for-users-explore-and-manage-conversation-sharing-features/
… #ChatGPT -
LangChain Retrieval Webinar Now Available on YouTube
By
–
Is there a better way to spend a Friday night than watching a LangChain Retrieval Webinar featuring @charles_irl @lateinteraction @jobergum
? No. No there is not. Now uploaded to YouTube so you can easily watch as many times as you want! -
Why Train Your Own LLM: Strategic Benefits Explained
By
–
Why did we train our own LLM? Why might this be a good idea for you?
— Replit ⠕ (@Replit) 26 mai 2023
Turns out there are a bunch of reasons!
If you want more, watch the AI panel with Claypot AI co-founder Chip Huyen, in conversation with Replit’s Amjad Masad & Michele Catasta.https://t.co/sLzgzpxyKJ pic.twitter.com/DjHv3i4wPuWhy did we train our own LLM? Why might this be a good idea for you? Turns out there are a bunch of reasons! If you want more, watch the AI panel with Claypot AI co-founder Chip Huyen, in conversation with Replit’s Amjad Masad & Michele Catasta. https://
youtube.com/watch?v=zXX0I6
dOPYk
… -
Berkeley AI PhD Class of 2023 Graduates Celebrated
By
–
Huge congratulations to the amazing @berkeley_ai PhD Class of 2023!! We will miss you and can't wait to see what you all accomplish!
-
Replit Teams Pro pricing Ghostwriter feature availability
By
–
Teams Pro does not feature Ghostwriter. It's either an addition $10 via Cycles, or $20 with individual Pro plan. See http://
replit.com/pricing for more info. -
AI vs Semantic Web: Do We Still Need Structured Data?
By
–
Does AI mean we don’t need the Semantic Web? – Terence Eden’s Blog One of the demands of the Semantic Web was that we should use HTML elements like to clearly mark up a contact address and we should wrap dates and times in the element. https://
bit.ly/3WpXhSw -
Complex Tasks Cause Knowledge Forgetting During Execution
By
–
I think the interesting observation here is that in the process of completing a larger, more complex task, it seems to "forget" this knowledge
-
Word Length Memorization Works for Common Words
By
–
yeah I understand that and you're right it might fail on edge cases, but for most common words (you can test all the words it produced in the output I posted to see for yourself) it has indeed "memorized" the right answer for the length of the word