Since many of you asked, here it is… our "Zero-to-LLM Engineer" bundle! We ( @towards_AI ) recently released our three core offers for any builders out there, together taking you from "zero" (literally, no coding knowledge or anything required) up to an advanced LLM developer
GENERATIVE AI
-

Model Training Scale: From 800K to 25 Trillion Tokens
By
–
their model is trained on 800K words, which is around 2.5M tokens. remember today's models are up to ~25T tokens (10^7 more, or 10 million million times) (they trained another model on 15M words)
-

Compact Language Model Architecture: 12M Parameters vs LLAMA 4
By
–
they use word embeddings + single-layer MLPs vocab size is 18K, context window is 6 words, hidden dimension is 60, word embedding have 100 dimensions their model has approx |V|(nm + h) = 17,964 × (6 × 100 + 60) = 12 million parameters about 200K times smaller than LLAMA 4…
-
Denied AI Capabilities: Understanding Limitations and Constraints
By
–
The denied capabilities tend to be informally specified (understanding, intentionality, reasoning, agency, creativity, selfhood, sentience, sapience, abstraction, common sense) but can also apply to specific tasks (categorizing an object as the Charles river, winning at Go).
-
Epistemological Challenges When Denying AI Capabilities
By
–
When capability of a class of Turing complete systems is denied ("a computer/perceptron/transformer can never do X") it poses interesting epistemological and metaphysical challenges, which are unfortunately rarely discussed ("how can anything do X without breaking physics?").
-
Capability Denialists Reject AI Approach Fundamentally
By
–
Capability denialists generally don't claim that the limitations of the AI system they criticize are due to capacity constraints that could be overcome (eg. with more memory, more compute, more data, algorithmic improvements), but that the entire approach is doomed.
-
Codex Model Limitations in Code Generation and Cursor Integration
By
–
My first experiences with Codex are that it makes the same mistakes other models do when one-shotting something in Cursor. It also failed to respond to feedback and hallucinated a bunch of stuff. Ended up fixing PR in Cursor. OpenAI also re-implemented a bunch of Github stuff
-
Gemini App Uses Ensemble of Models for Query Responses
By
–
No, Gemini app uses an ensemble of models to answer queries
-
Negative Understanding of LLMs: A Gary Marcus Critique
By
–
to garymarcus harder than the man himself, you had to acquire not zero but negative understanding of LLMs; respect
-
AGI Alpha: Unprecedented $15 Quadrillion Market Opportunity
By
–
"AGI Alpha" : The Greatest Alpha Opportunity Ever Predicting the sectors AGI will revolutionize first is the key to unlocking a historic, unprecedented opportunity—capturing a share of a projected $15 Quadrillion shift. Join the frontier: http://
github.com/MontrealAI/AGI
-Alpha-Agent-v0
…
