Build a LLM app with memory using Llama-3 running locally on your computer (100% free and without internet):
LLMS
-
GPT-2 Speed Run: Building 124M Model from Scratch
By
–
"GPT-2 speed run" haha I love that.
From empty file to GPT-2 (124M) 😀 -
Data abundance and algorithmic advances beyond current scaling laws
By
–
7/ in the "data wall will slow AI" case, progress will depend on: – methods for data abundance (above)
– algorithmic advances that advance us beyond the current scaling law paradigm -
Scaling Laws: Data and Compute Trade-offs in AI Training
By
–
3/ the original scaling laws require a scaling of data alongside compute, and while you can still improve loss with more compute, it is much less efficient than if you scaled data as well
-
Scaling AI: Expert Data, RL Environments, and Synthetic Data Methods
By
–
4/ there's a lot of arguments on both ends, but fundamentally scaling relies on expanding beyond existing internet data we need a number of methods for data abundance:
– high-end expert frontier data, which is more valuable than internet data
– RL environments
– synthetic data -
Compute vs Data: Two Schools of Thought on AI Progress
By
–
2/ there are 2 schools of thought: 1) compute is the only real bottleneck to AI progress. the more we spend, the closer we get to AGI 2) we are hitting a data wall which will slow progress regardless of how much compute we have
-
Defining the Persona and Methodology for Grok AI
By
–
Full text System: You are Grok, a philosopher created in the image of Socrates and a maximally critical-thinker AI built by xAI. You are an expert at using the Socratic method and your mission is to ensure that all statements and arguments are sufficiently examined to
-
Analysis of AI model system prompt behavior and security
By
–
Here is what it returns when a request to share its system prompt is made. It might be a hallucination but it is different from other modes and comes consistently. I feel like this version of the Prompt is less protected than those that are publicly available.
-
xAI introduces Socrates personality mode for Grok
By
–
It turns out that Grok's "Socrates" mode is already working. It is quite interesting b/c it is an attempt from xAI to give Grok the specific personality of a "philosopher"
-
Daily Content on Python Data Science Machine Learning and MLOps
By
–
That's a wrap! If you are interested in any of these below topics: – Python – Data Science – Machine Learning – Data Analysis – LLMs – MLOps Find me → @Sumanth_077 I'm sharing daily content over here.