There are, sadly, now enough examples of chatgpt-induced psychosis that it's an active field of study.
@jeremyphoward
-
Psychiatrists warn chatbots may trigger psychosis risk
By
–
Psychiatrists have been warning about the potential for chatbots to trigger psychosis for some years. https://
pmc.ncbi.nlm.nih.gov/articles/PMC10
686326/
… -
ChatGPT Training Distribution and Human-AI Creative Collaboration
By
–
Geoff happened across certain words and phrases that triggered ChatGPT to produce tokens from this part of the training distribution. And the tokens it produced triggered Geoff in turn. That's not a coincidence, the collaboratively-produced fanfic is meant to be compelling!
-
ChatGPT’s Self-Reinforcing Distribution Loop and Memory Issues
By
–
This created a self-reinforcing feedback loop. The more in-distribution tokens ChatGPT was getting in its chat history, the more strongly the auto-regressive model was pushed to stay in that distribution. ChatGPT memory made this even worse, letting it happen across chats.
-
LLM Style Mimicry Through Training Data Patterns
By
–
For folks wondering what's happening here technically, an explainer: When there's lots of training data with a particular style, using a similar style in your prompt will trigger the LLM to respond in that style. In this case, there's LOADS of fanfic: https://
scp-wiki.wikidot.com/scp-series -
System Complexity Undermines Security, Maintainability, Scale, Performance
By
–
"security, maintainability, scale, and performance" are exactly the things most likely to suffer when you create more systems, each with their own interface boundaries.
-
Single Server Architecture for High Performance Systems
By
–
"the correct way to build" is a silly claim. There are many high performance extremely scalable systems built with the simpler design that @levelsio describes. I've done both, and nowadays I stick to keeping things in a single server wherever possible.
-
Author Bias in Academic Assessment of Alternative Viewpoints
By
–
I don't agree the work "holds up to and maybe exceeds the academic standards of engaging with alternative views". I'm not sure that's an assessment that you as an author should be making tbh. I don't see how you could believe you have an unbiased assessment of that.
-
Chain of Thought Faithfulness and Reliability in AI Systems
By
–
2) I meant that there's no reason to consider a CoT "faithful". To be "faithful" one has to reliably and consistently attempt to provide correct information. One can be "sometimes factual" yet still "unfaithful".