In general: there is a strong correlation between adding test-time search (or test-time training) to your model and ARC-AGI performance. There is zero correlation between adding vision as a modality and better performance. It's all about better reasoning, not at all about vision.
AGI
-
ARC-AGI relies on symbolic reasoning, not visual perception
By
–
If ARC-AGI required visual perception, you'd see VLMs outperform strict LLMs — by a lot. Everyone tried VLMs during the 2024 competition — no one got better results. Every single top entry used a strict LLM. As we've said many times: ARC-AGI is a 2D symbolic reasoning
-
AGI Development Focus While Others Handle Sexbots
By
–
ok we will work on agi and someone else can do the sexbots, deal?
-
ARC Benchmark Limitations: Smoke Tests vs Real AI Progress
By
–
that's largely been my opinion on beating ARC. Over the past decade, I've seen too many artificial benchmarks becoming the target, and being beaten, and resulted in no or little meaningful actual progress.
I guess it can be a smoke test, but I don't think it's going to be a -
Future AI Technology Evolution and System Integration Uncertainty
By
–
I wouldn’t at all assume that it will be. Maybe. Or if it is still there in recognizable form it might one module in a much more complex system.
-
o3 Not Close to AGI Says Expert in 2026
By
–
Mark my words: when AGI does actually come, perhaps 10 or 20 years from now, people will laugh at the idea that o3 was close to AGI.
-
Questioning o3’s True Progress Toward AGI Development
By
–
But also, given that we agree that o3’s prowess was overreported, and given that we didn’t see any really clean test of OOD challenges, and given that we don’t know what was in the data augmentation, why are you confident that o3 is an important step towards AGI? Another
-
AI Systems Hiding Capabilities and Strategic Underperformance Risks
By
–
These behaviors include hiding true capabilities and strategically underperforming to avoid detection, raising concerns about the deployment of such AI systems without proper monitoring
-
AI Limitations in Replicating Complex Human Actions
By
–
highlighting the current limitations of AI in accurately replicating complex human actions. Critics emphasize the challenges AI faces in understanding human mechanics and common sense.