Take this from @Steve_Yegge (
https://
about.sourcegraph.com/blog/cheating-
is-all-you-need
…) and add this from @simonw (
https://
simonwillison.net/2023/Mar/27/ai
-enhanced-development/
…) and this from @peternixey (
https://
x.com/peternixey/sta
tus/1640002493630369792?s=20
…) and it's clear that something big is going to happen, and probably faster than we'd like, to AI and software development
GENERATIVE AI
-
AI Development Acceleration: Major Changes Ahead for Software Engineering
By
–
-
AI Requires New Startup Building Paradigm and Approach
By
–
I don’t agree! I think AI as a paradigm to build tech and products is very different than traditional software and requires an update on how we build and suggest to build startups
-
Lean Startup Methodology for AI: Building Differentiation Beyond PMF
By
–
We need the equivalent of the “lean startup” book/movement by @ericries but for AI. Very different paradigm IMO to build startups. For ex, it’s easier to get to wow effect/illusion of pmf but harder to differentiate/retention/stay up to date on cutting edge. Who’s working on it?
-
Sam Misses Broader Message on Model Transparency
By
–
sam seems like he is picking up on part of the message from the jailbreaking community however, he fails to address the broader message calling for more model transparency in general
-
OpenAI unlikely to increase model transparency despite necessary pressure
By
–
it's improbable that OpenAI will ever disclose additional information about new models compared to what they revealed for GPT-4 (I expect it will diminish even further) but nevertheless, I think the pressure on them to do so is healthy and necessary
-
Training LLMs to Use Multiple LLMs as Tools
By
–
– Toolformer showed you can train LLMs to use tools. – HuggingGPT showed that you can use LLMs as tools. Who wants to train an LLM that uses other LLMs that can use tools? Can 100+ small LLMs outperform #GPT4?
-
Chat-fished: Mistaking AI-Generated Text for Human Writing
By
–
Getting “Chat-fished”: when you read something assuming it was written by a human but…
-
Photoshop and generative AI: history of image manipulation tools
By
–
que font ils depuis que photoshop existe ? 😉
-
GPT-4 Limitations: Long-term Planning and In-context Learning
By
–
For example, GPT-4 still doesn’t seem to consistently follow long term plans (if you are developing agents with LLM in the loop), or emulate idiosyncratic personalities, or learn in-context new facts that contradict facts that are already in weights. But my guess is that OpenAI
-
Fine-tuned LLMs vs General Models: When Customization Matters
By
–
Yeah, the need for customized find-tuned LLMs decreases when the general LLM can do what you need out of the box. The only use I see for fine-tuned LLMs is when GPT-4 doesn’t want to do what you need, and prompt engineering doesn’t help.