3/ the original scaling laws require a scaling of data alongside compute, and while you can still improve loss with more compute, it is much less efficient than if you scaled data as well
GENERATIVE AI
-
Scaling AI: Expert Data, RL Environments, and Synthetic Data Methods
By
–
4/ there's a lot of arguments on both ends, but fundamentally scaling relies on expanding beyond existing internet data we need a number of methods for data abundance:
– high-end expert frontier data, which is more valuable than internet data
– RL environments
– synthetic data -
Compute vs Data: Two Schools of Thought on AI Progress
By
–
2/ there are 2 schools of thought: 1) compute is the only real bottleneck to AI progress. the more we spend, the closer we get to AGI 2) we are hitting a data wall which will slow progress regardless of how much compute we have
-
Defining the Persona and Methodology for Grok AI
By
–
Full text System: You are Grok, a philosopher created in the image of Socrates and a maximally critical-thinker AI built by xAI. You are an expert at using the Socratic method and your mission is to ensure that all statements and arguments are sufficiently examined to
-
xAI introduces Socrates personality mode for Grok
By
–
It turns out that Grok's "Socrates" mode is already working. It is quite interesting b/c it is an attempt from xAI to give Grok the specific personality of a "philosopher"
-
Generative ConvNets for Video: A Decade of AI Innovation
By
–
Us indeed! A decade earlier, in 2010, we organically introduced generative convnets for video understanding and generation. I remember presenting it at NeurIPS and Jitendra Malik rightfully asking us to scale and evaluate. Yet, I argued against most of the vision community at the
-
MLX: Deep Learning Framework for Machine Learning on macOS
By
–
7. MLX: A deeplearning framework for machine learning on macOS! You can efficiently train and deploy ML models. The repo also includes examples to run open-source models using MLX, like LLaMA, Mixtral 8x7B, LoRA, CLIP, Whisper and Stable Diffusion. https://
github.com/ml-explore/mlx -
Pandas AI: Generative AI for Data Analysis and Visualization
By
–
2. Pandas AI Pandas AI adds Generative AI capabilities to Pandas. Now you can analyze complex data frames and plot visualizations just by using natural language.
-
HippoRAG, Langgraph, GraphAI for RAG and Agentic Workflows
By
–
My guts says yes. Seems helpful for both RAG and agentic workflows. Check out HippoRAG for the former and Langgraph or GraphAI for agentic workflows
-
Idea for ChatGPT extension to automate message modifications
By
–
ngl i have thought of making a chatgpt extension that just auto appends these modifications to messages so as to get the followups without effort