Quantifying Theoretical AI Alignment Guarantees: Receiver-Utility Bounds in Bayesian Persuasion

This research paper explores theoretical AI alignment through the lens of Bayesian persuasion, specifically examining how a misaligned AI agent might manipulate information. The authors utilize a bit-string model to analyze the interaction between an AI sender aiming to maximize "1" guesses and a human receiver seeking accuracy. A primary contribution is the establishment of a universal upper bound, proving that the receiver's utility under a strategic AI is at most 1.5 times the utility they would obtain without any signals. The study further demonstrates that this bound becomes tighter when the information follows independent product priors, as these limit the...