r/rational • • 19h ago

Seeking recent short story about "perfectly" aligned AI

4 Upvotes

Hi, wondering if anyone can pin this down for me. (Before you ask - neither chatgpt, gemini or claude could).

It's a story about a perfectly aligned AI. I presume recent as I read it during the last year.

It appears perfectly aligned because it never thinks anything wrong. The story focuses on a dialog between it and an AI researcher. When asked, it honestly and transparently outputs a list of hundreds of potential alignment issues that need researching.

But despite the appearance of perfect alignment, there are some subtle patterns in the thoughts it avoids having in the first place.

Please tell me one of you folks wrote it :)


r/rational • • 11h ago

AGARES 12-14 (Villian/Stairway/Blush)

Thumbnail
royalroad.com
26 Upvotes

r/rational • • 11h ago

Doomsday Pivot! - Chapter 22 (A story written by Alexander Wales, available now on Royal Road)

Thumbnail
royalroad.com
10 Upvotes