I watched a video of someone asking their AI assistant if they should drink from a "water bottle" they found, which was in fact a bottle of bleach.

The AI did exactly as expected: "you go, girl! Drink from that water bottle, you super genius!"

It's concerning, of course, that this "tool" people are being told to trust is worse than useless, but frankly it was how much pointless, silly praise the bot was spitting out that really deserved me.