What's your TTFT and throughput on 1 H100 DGX node for the 405b?
LLMS
-
Deep Dive into Transformers: Foundational AI Architecture
By
–
Deep Dive into Transformers by Hand ✍︎ https://
bit.ly/45XLXSg
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Real-time search grounding versus direct LLM results comparison
By
–
You’re comparing real time search grounding snd direct LLM result, which is incorrect.
-
Scaling Laws: Training Duration and Model Size Optimization
By
–
For how long should you train your language model? How large should your model be? Research from @DbrxMosaicAI proposes a modified scaling law that quantifies the training-inference trade-off – producing models that are optimal over their total lifetime. https://
dbricks.co/3zSwPJX -
Google Gemini 1.5 Pro Surpasses GPT-4o Claude Sonnet
By
–
Google ha tenido una semana muy movidita con muchos anuncios importantes. Pero de todos quizá el más sorprendente es el de su nuevo modelo Gemini 1.5 Pro experimental, que se ha puesto por delante de GPT-4o y Claude Sonnet 3.5. Os lo cuento en DotCSV Lab (Link abajo)
-
Chatbots Aren’t Nurses: Beyond AI Test Scores
By
–
Alt text for video: Audiogram with with Mystery AI Hype Theater 3000 logo and headline "Episode 36: Chatbots Aren't Nurses" and subhead "Why chatbot scores on drug interaction tests don't translate to meaningful care" >>
-
Barebones vs Perplexity: Context Window Management Differences
By
–
Barebones doesn't keep sources in context while Perplexity does, hence why you get the running-out-of-context issues. But being addressed.
-
Using ChatGPT for Growth Hacking Strategy Development
By
–
8. Growth Hacking Strategies
— God of Prompt (@godofprompt) 3 août 2024
Prompt:
"ChatGPT, suggest some growth hacking strategies to rapidly expand my customer base for [Your Product/Service]." pic.twitter.com/VyfZcmYbf18. Growth Hacking Strategies Prompt: "ChatGPT, suggest some growth hacking strategies to rapidly expand my customer base for [Your Product/Service]."
-
Using ChatGPT for the Five Whys Root Cause Analysis
By
–
5. The Five Whys
— God of Prompt (@godofprompt) 3 août 2024
Prompt:
"ChatGPT, use the Five Whys technique to identify the root cause of [Specific Problem] in my business." pic.twitter.com/DjoqC8ShZ15. The Five Whys Prompt: "ChatGPT, use the Five Whys technique to identify the root cause of [Specific Problem] in my business."
-
Using ChatGPT to Align Team Goals with OKRs
By
–
3. OKRs (Objectives and Key Results)
— God of Prompt (@godofprompt) 3 août 2024
Prompt:
"ChatGPT, guide me in setting up OKRs for [Your Business/Project] to align team goals and drive performance." pic.twitter.com/7s3P3kkfxA3. OKRs (Objectives and Key Results) Prompt: "ChatGPT, guide me in setting up OKRs for [Your Business/Project] to align team goals and drive performance."