I guess this is where we disagree about whether an error of 3261X in estimating the cost of training a language model, or conflating a completely different one-time task to perform a neural architecture search (and overestimating that cost by 88X) to find more energy efficient
LLMS
-
Training LLMs for Long Context Manipulation Tasks
By
–
Oh yes I see. Yes my hope is that it’s something solvable (i like on this topic eg Jina’s work) but we will need to train them more specifically on (long) context manipulation tasks. We’re lacking a bit of open benchmark/evals on this as well (simple manipulation without complex
-
SambaNova Cloud Achieves Fast Llama 3.2 Inference Performance
By
–
If you're looking for fast #AI #inference on @AIatMeta
's Llama 3.2, we've got you covered! Running at full-precision, SambaNova Cloud achieves 2470 tokens per sec on 1B and 1566 tokens per sec on 3B Start developing -
Small AI Models: Strategic Use Beyond Knowledge Storage
By
–
You have to use these small models differently than the larger ones, typically not as knowledge ressource (they have limited storage capacity) for instance but more for creativity, reformulations, processing, etc. With external tools (eg search) and long context, they will become
-
Llama 3.2 achieves 10x improvement over previous generation
By
–
the new 1 billion parameters Llama model (version 3.2) is head-to-head with the 13 times larger version of one years ago (llama 13B version 2) on lmsys chatbot arena exciting to see such 10x improvements on challenging benchmark it's an amazing sign for small/local/open models
-
Build Your Own OpenAI Assistant with Open Source Tools
By
–
What if you could create your own OpenAI Assistant with Realtime API that can:
— FlowiseAI (@FlowiseAI) 7 octobre 2024
🌐 Browse the Web
📚 Search Files (RAG)
💻 Run Code Interpreter
All using open source tools.
Check it out pic.twitter.com/7Mm6YxJWflWhat if you could create your own OpenAI Assistant with Realtime API that can: Browse the Web Search Files (RAG) Run Code Interpreter All using open source tools. Check it out
-
LLM Chatbot Web UI with LangChain and Hugging Face Integration
By
–
LLM Chatbot Web UI This project is a Gradio-based chatbot application that leverages the power of LangChain and Hugging Face models to perform both conversational AI and PDF document retrieval. The chatbot is capable of handling text-based queries, generating responses based on
-
Natural Language AI Autonomy Levels Task Execution
By
–
Accepts instructions in natural language, executes autonomously with minimal intervention. Varying levels of autonomy based on task and system intelligence.
-
LLM Agency: How Agentic Applications Control Their Flow
By
–
The more agentic an application is, the more an LLM decides the control flow of the application
-
OpenAI Solutions Architect Discusses Real-World LLM Applications
By
–
Hearing from OpenAI lead solutions architect Juston Forte about real-world uses of LLMs. #CogX