Yeah, we removed the 10 minute session limit. Plus when running AI NPC (LLM) on your local PC, there's no cost, and no time limit to it. Transparency notice: if you will continue using TTS (text to speech), this is still running in cloud and there's cost associated to it. We
CODE
-
TÜLU 3 releases state-of-the-art open post-trained models
By
–
8). TÜLU 3 – releases a family of fully-open state-of-the-art post-trained models, alongside its data, code, and training recipes, serving as a comprehensive guide for modern post-training techniques.
-
Star Attention: Efficient LLM Inference for Long Sequences
By
–
6). Star Attention: Efficient LLM Inference over Long Sequences – introduces Star Attention, a two-phase attention mechanism that processes long sequences by combining blockwise-local attention for context encoding with sequence-global attention for query processing and token
-
o1 Replication: Distillation and Fine-tuning for Math Reasoning
By
–
3). o1 Replication Journey – Part 2 – shows that combining simple distillation from o1's API with supervised fine-tuning significantly boosts performance on complex math reasoning tasks…
-
Complete Data Science Learning Resource Handbook Guide
By
–
GitHub – andresvourakis/data-scientist-handbook: This is a repo with links to everything you'd ever want to learn about data science https://
bit.ly/3N6nZvo
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Embedding Models in RAG Pipelines: Essential Guide
By
–
Good morning everyone! Today, we dive into an important part of the Retrieval-Augmented Generation (RAG) pipeline: the embedding model. All the data you have will be entered into embeddings, which we’ll then use to retrieve information. So, it’s quite important to understand
-
Remote GPU Kernel Launch Capability Remains Unconfirmed
By
–
No, still not clear — you can access the memory of all of them, but nobody has yet confirmed you can launch kernels on remote GPUs.
-
Distilling Llama 3.1 8B into 1B using torchtune
By
–
Distilling Llama3.1 8B into 1B in torchtune https://
bit.ly/3Z67K7l #AI #MachineLearning #DeepLearning #LLMs #DataScience -
xAI Engineer Shares Hackathon Insights and Industry Updates
By
–
xAI Product Engineer, Belce Dogru, shares what’s cooking up at our hackathon + the industry
-
Google AI Studio adds LaTeX support
By
–
Google AI Studio got LaTeX support for math-related queries