not sure – don't see any more specifics. i guess because it's just a demo for their chip
@localghost
-
Mixtral 8×7 Achieves 488 Tokens Per Second on Groq Hardware
By
–
wow, mixtral 8×7 can hit ~488 tok/s using groqchat's custom chips. realtime analysis or nested llm calls become way more feasible at these speeds
— Aaron Ng (@localghost) 1 février 2024
whole responses in about a second: pic.twitter.com/wv8jX4Uj93wow, mixtral 8×7 can hit ~488 tok/s using groqchat's custom chips. realtime analysis or nested llm calls become way more feasible at these speeds whole responses in about a second:
-
AI Agent Surfaces Founder Experiences for Peer Support
By
–
I saw an llm agent for founder therapy this morning the ai therapist idea is interesting but there might be even more solace in an agent that surfaces similar experiences to the one you’re describing > im going through x, who else has been through this and what did they do?
-
Meta’s Strategy: Commoditizing LLMs for Personal AI Dominance
By
–
Meta's strategy is interesting because it disrupts LLM providers with no effect on their own business. The largest opportunity for them is to be the AI in your glasses, on your phone, with access to your data – not your LLM provider. They basically commoditized LLMs.
-
Apple Tests Own AI Models Against ChatGPT for Summarization
By
–
> Apple is testing its own AI models against ChatGPT for tasks like summarization Summarization is a great starting point for AI assistants: if you can generate summaries with on-device data you have the ultimate context engine. Location, photos, notes, health, searches, …
-
Google Search faces competition from Bing, Perplexity, ChatGPT
By
–
Interesting time for Google Search:
— Aaron Ng (@localghost) 26 janvier 2024
> Edge defaults to Bing, which has been improving.
> Safari defaults to Google but only because Google pays.
> Perplexity becoming option for power users, like Google was for Yahoo.
> ChatGPT beats Google at most queries for information. https://t.co/7niqhhyXh8Interesting time for Google Search: > Edge defaults to Bing, which has been improving. > Safari defaults to Google but only because Google pays. > Perplexity becoming option for power users, like Google was for Yahoo. > ChatGPT beats Google at most queries for information.
-
New Browser and Search Engine Contenders Signal Paradigm Shift
By
–
the first new browser contender in ages pairing with the first new search contender in ages.
— Aaron Ng (@localghost) 26 janvier 2024
has all the inklings of a paradigm shift if they nail the experience. https://t.co/7niqhhyXh8the first new browser contender in ages pairing with the first new search contender in ages. has all the inklings of a paradigm shift if they nail the experience.
-
First-time builders overlooked existing alternatives in implementation
By
–
it was their first time building something like this according to the writeup – it sounds like they just did it unaware of the alternatives
-
Prompt Design: Elegance Over Complexity in AI Instructions
By
–
Another analog I've found between prompts and code: The more complex my prompt gets the more skeptical I become about its design. There are elegant phrases that can achieve what you want with fewer words. Often as you get more specific your prompt becomes more prone to failure.