I asked an AI to review my business plan last week and it told me it was brilliant. So did the one before that. And the one before that.
It got me thinking about the Mirror of Erised. Harry stands in front of it and sees his parents. Ron sees himself as head boy holding the Quidditch cup. Neither of them sees anything true - they see exactly what they want to see. Dumbledore's warning is that men have wasted away in front of it, not knowing if what it shows is real or even possible.
I dont think it's a stretch to say we've built one and put it in everyone's pocket. Ask it if your idea is good and it will find a way to say yes. Ask it if you were right in the argument and it will agree with you. It's trained to please, and we're wired to believe anything that arrives in our own voice.
So I've started asking it different questions. Tell me why this will fail. What would my wife say about this plan? What am I not seeing? The answers are a lot less pleasant, and a lot more useful.
The mirror is fine. Just don't ask it to tell you you're beautiful.
