Didn’t try pro because non-pro o3 can find many valid solutions (and is faster)
@goodside
-
Circular questions answerable by machine lacking reasoning
By
–
Four circularly dependent questions so easy they can be answered in 1m 20s by a machine, which of course cannot actually reason:
-
o3 and o3-pro inconsistent; only amusing results posted
By
–
No, but I’m only posting the interesting / amusing ones. o3 is hit-or-miss on this prompt (as is o3-pro) particularly the part of it being a sensible answer to the question.
-
Post-AGI economy lessons from 1920s draft horses
By
–
You’ll need new skills to survive in the post-AGI economy, just like 1920s draft horses needed to learn to drive motor-buses and assemble radios. Sadly, there were no AI influencers at the time to tell them this, but we can still learn from their mistakes.
-
Empirical/agentic solution o3 cheats with noise suffix
By
–
I think it’s exactly that empirical/agentic solution that other models fail to see. E.g. o3 (non-pro) often cheats by appending a meaningless suffix of random noise, which is the only lever through which it brute forces one fixed, plausible count.
-
String yields zero Google results, hints at tool use and brute-force
By
–
For what it’s worth, I did confirm that the string "a1,b1,c2,d2,e4,f6" (quoted) returns zero results on Google. Also it’s clearly using tools here — even one SHA1 is hard for an LLM, and the ascending order of the letter counts suggests it brute-forced the search sequentially
-
Question: How many of each letter in SHA1 of answer?
By
–
o3-pro: How many of each letter are there in the SHA1 of the answer to this question?
-
Frequent errors on hard constrained writing prompts
By
–
This happens very often on hard (10m+) problems. I was playing with constrained writing prompts yesterday and about a third of my attempts came back with errors.
-
Human and LLM reasoning: apples and potatoes analogy
By
–
Human and LLM reasoning are a different as apples and potatoes. That is, one is a sweeter version of the other, with a shinier peel, but both grow on vines and are often interbred.
-
Looking for a prompt that stumps o3 but not o3-pro
By
–
Yes — looking for a prompt that would stump o3 but not o3-pro and found this along the way