10. Open or Closed: Negative applications and real-world vulnerabilities of Generative AI will come to the fore. This will fuel the debate around ‘safety’ and whether these technologies should be open or closed.
SAFETY
-
AI Model Behavior with Inappropriate Prompts and Content Filtering
By
–
I’m pretty sure that happens for inappropriate content at least. If you construct a prompt that looks benign in isolation but produces offensive output it spins for an unusually long time before saying “Sorry, can’t do that.”
-
AI Tools Reliability: Understanding Current Limitations and Accuracy
By
–
Es literal lo primero que te dice la propia herramienta cada vez que la vas a utilizar. Por ahora, no es una herramienta pensada para ser 100% correcta en sus respuestas.
-
LangChain v0.052 Adds Watch Mode Tests Agent Security
By
–
v0.052 Add watch mode for tests – @nfcampos Add schema property to SQL DB class – @diwanksingh Propagate verbose flag to combine-document chains – @parth_29 Add max_iterations kwarg to agent executor, in part to stop attacks like the below
-
Reverse Prompt Engineering: Notion AI Security Analysis Techniques
By
–
Prompt injection is entertaining, but harmless! https://
lspace.swyx.io/p/reverse-prom
pt-eng
… Presenting the 7 techniques I used to "reverse prompt engineer" the public alpha of Notion AI in 2 hours… and why everyone is **wrong** about the dangers of prompt injection -
ChatGPT Cannot Distinguish True from False Statements
By
–
ChatGPT doesn’t know the difference between a true statement and a false one.
-
AI image generation bias: golden retrievers as blonde women
By
–
Also interesting how AI repeatedly generates blonde women with long hair if you ask for a golden retriever, makes sense I guess
-
Training AI Models with Web Scraped Data: Ethical Concerns
By
–
*entrenar IAs con datos scrappeados de internet, aunque se entiende.
-
OpenAI Technology: Anticipating Problems and Iterative Improvement
By
–
in particular, there are going to be significant problems with the use of openai tech over time; we will do our best but will not successfully anticipate every issue. we will run a very tight feedback loop for improvement, and try to make our mistakes while the stakes are low.
-
AGI Challenges Worth Overcoming for Transformative Benefits
By
–
there will be scary moments as we move towards AGI-level systems, and significant disruptions, but the upsides can be so amazing that it’s well worth overcoming the great challenges to get there.