BenchLLM by @V7Labs is a Python-based open-source library that streamlines the testing of Large Language Models (LLMs) and AI-powered applications. It measures the accuracy of your model, agents, or chains by validating responses on any number of tests via LLMs.
LLMS
-
Flan-UL2 32B with improved tokenizer could dominate open source
By
–
a flan-ul2 32b with a new (not-horrible) tokenizer is going to beat all open source models out there today. someone at google should do it.
-
Vit-22b and Flan Collection Presented at ICML Conference
By
–
Vit-22b and flan collection are presented at @icmlconf
! -
ChatGPT ends essays, new education focuses on asking questions.
By
–
With ChatGPT, school essays are on their way out. We need a new education system focused on teaching children how to use AI chatbots to seek knowledge. The real answer has always been knowing what questions to ask.
-
List of Open Source LLMs Available for Commercial Use
By
–
GitHub – eugeneyan/open-llms: A list of open LLMs available for commercial use.
https://bit.ly/3MG7VRA #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Perplexity Deploys LLaMa Faster Than Competitors
By
–
Perplexity did not have pre-release access to LLaMa unlike HF/Replicate. We got the checkpoint at 12:18 pm that day, and the release of http://
labs.pplx.ai happened at 7:00 pm. And yet faster than the other alternatives 🙂 -
Temperature Zero Settings Not Completely Deterministic in AI Models
By
–
Note that even temperature 0 will not be 100% deterministic, but it should be very close:
-
Poe Adds Custom Temperature Control for Prompt Bots
By
–
You can now set a custom temperature on prompt bots on Poe! Read on for more details about the change in this thread:
-
Temperature Parameter Controls AI Bot Consistency Creativity
By
–
Temperature allows you to make a bot more consistent, to the point where it will be close to deterministic with temperature=0, or more creative and unpredictable with higher temperatures.
-
Free Generative AI Conference on LLMs and AI Agents
By
–
Free Generative AI Conference on LLMs and AI Agents: This half-day event features top AI/Ml leaders, researchers from prestigious universities, tech companies, and more! And, of course, @Noahpinion
! July 25, 2023 Reserve your spot here: https://
eventbrite.com/e/stateofthear
t-free-generative-ai-conference-on-llms-and-ai-agents-tickets-641826449187
….