Eval awareness in Opus 4.6 is a bit alarming TBH. If the model behaves differently when it thinks it's being tested, what are we actually measuring?
@whats_ai
-
Micro-benchmarks Don’t Measure True Reasoning Capabilities
By
–
These micro-benchmarks are fun but I've found the model that "wins" changes depending on the exact framing of the prompt. Pattern matching != reasoning.
-
AI as Project Manager: The New Hiring Paradigm of 2026
By
–
The irony of AI hiring humans is peak 2026. Though honestly this might be the real business model… AI as the project manager nobody asked for.
-
DIY Chatbot Integration Fails Without Professional Expertise
By
–
That’s what “why pay an expert, I can easily vibe code and integrate the chatbot in our interface myself” looks like
-
AI Engineering Fundamentals Bootcamp at Uphill Conf 2026
By
–
I've spent years teaching AI engineering (mostly online).
This May, I'm taking it to the stage. I'll be at @uphillconf 2026 in Bern, Switzerland. A full-day workshop on May 7 and a conference talk on May 8. → 1/Workshop – May 7 "AI Engineering Fundamentals Bootcamp"
A -
Claude Consistency Issues With Detailed AI Skills Configuration
By
–
That’s for sure! What are you looking into these days that is failing for you? On my end, still struggling with consistency even if I have super detailed Claude skills, some stuff are quite random and can’t manage to make them the same every time.
-
Transforming Business Processes Into AI Skills and SOPs
By
–
It's such a useful feature. I'm transforming almost all my processes into skills, kind of using them as SOPs haha
-
One-Shot iOS App Development: From Months to Minutes
By
–
I remember coding my first very basic iOS app in months haha. The fact that this is one-shot now is insane.
-
Balancing specialization with experimentation in tool adoption strategy
By
–
Totally agree! Specializing definitely pays out. But there’s still a point where you need to keep some kind of experiment vs. Exploitation ratio for new tools, else we’d still be stuck with what we were using years ago. But that’s my usual take to wait a few months and see
-
New Agentic AI Engineering Course with Multi-Agent Projects
By
–
Our new course, "Agentic AI Engineering," contains 17 notebooks and a complete multi-agent project (because you can't learn to build production agents through notebooks only). Notebooks are really powerful for teaching the core concepts quickly and easily to anyone. Which we can