"Alignment Forecasting: Predicting Misalignment From Training Data" This paper has an AI inspect the training data and forecast whether fine-tuning will increase behaviors like deception, sycophancy, or sabotage. Their decomposed forecaster reaches 0.801 at predicting whether
Alignment Forecasting Predicts Misalignment From Training Data
By
–
