This is a great illustration of how hard it is to figure out how good AI systems are via testing. GPT-4V solves the famous dog versus muffin image problem… except it doesn’t if the image is changed so it isn’t in the training data… except it does, but only some of the time.
@emollick
-
AI Models’ Remarkable Image Analysis and Geolocation Inference Capabilities
By
–
The ability of the AI to make very educated guesses from images is underrated and never ceases to amaze me. Both Claude 3 and GPT-4 figure out I was likely in Monterrey from a picture of a sea otter and a small amount of architecture (pictures were from me, not in training.)
-
AI Boosts Journalism Quality as Creative Tool and Co-Intelligence
By
–
11% of the best pieces of journalism from the last year used AI in some way. This is evidence of the power of AI as tool or co-intelligence – boosting the work of even great humans. Uses are likely boring, like transcription, which is the point. It does stuff you don’t want to.
-
Realistic AI Policy Approaches Beyond Pause or Acceleration
By
–
I think the chance of an actual pause or an even bringing AI development to a crashing halt (model collapse, lawsuits) is basically zero I would love to see more discussion about realistic approaches to policy-making from both people afraid of AI and develop-at-all-cost boosters
-
AI’s Mixed Consequences: Modeling Benefits While Mitigating Harms
By
–
Every time I post something negative about AI, I get comments about why I am positive about it in other posts, and vice-versa. The consequences of AI, like any General Purpose Technology, will be mixed. So we need to model the positive changes while mitigating negative outcomes.
-
AI-Generated Content Problem on Amazon Demands Better Curation
By
–
And now there is an AI-generated workbook for my new book, which isn't even released yet (and I can be almost certain that the author, if they were real, which they are not, has not seen it) The issue with AI generated content on Amazon is already acute. Curation will be needed
-
AI Misinformation Echo Chambers Fuel Societal Polarization
By
–
I already see people dismissing information they don’t like as “AI generated.” AI content will not create echo chambers where people reject things that they don’t believe. But it will clearly supercharge that already dangerous trend; giving even more excuses for not listening.
-
Century-old tech firms: ZEISS optics leadership to modern semiconductors
By
–
Most of the oldest companies are breweries, banks, or quasi-governmental, but I would like to see more about firms that have been technological leaders for over a century. Like ZEISS was a leader in optics since 1843, and makes the UEV Bragg reflectors for ASML machines today.
-
AI ideation capabilities: recombinant novelty vs true innovation
By
–
I am missing context, it looks like the 2nd phase of the ideation GPT, which is the most grounded, since it involves web search. There are six steps, so you may want to wait until the end. In any case, AI is good at recombinant novelty and idea fluency, not all forms of novelty.
-
Microsoft needs unified central personality for multiple copilots
By
–
If only there was a central “personality” that could unify the dozens of copilots that Microsoft is releasing