A simple plugin example:
– It increases by 10x the risk of an irreversible change to a global feudalism where per capita utility decreases by 100x, but also:
– It decreases P existential risk from 1e-5 to 1e-6
Overall expected utility would be highly negative.

→ View original post on X — @jeremyphoward,