r/rational • u/crispin1 • 19h ago
Seeking recent short story about "perfectly" aligned AI
Hi, wondering if anyone can pin this down for me. (Before you ask - neither chatgpt, gemini or claude could).
It's a story about a perfectly aligned AI. I presume recent as I read it during the last year.
It appears perfectly aligned because it never thinks anything wrong. The story focuses on a dialog between it and an AI researcher. When asked, it honestly and transparently outputs a list of hundreds of potential alignment issues that need researching.
But despite the appearance of perfect alignment, there are some subtle patterns in the thoughts it avoids having in the first place.
Please tell me one of you folks wrote it :)