I'd worry that this distance is shallower than the distance between "What are your opinions on medical ethics" and observing what happens when an LLM talks to a susceptible patient.
Concerns about shallow distance between LLM ethics and real patient harm
By
–