Some clients remove the ability to send/receive DMs with remote signers (Nostur does this too). I believe the reason being if your DM inbox is very large, it will take a long time to round trip all of those encrypted events. But not sure re: Yakihonne's design. A DM inbox of a few thousand messages will take a few minutes to decrypt if using Clave and a good connection.