Hermes also never figure it out. Yeah that's probably the solution, but in the end I did install my own matrix server, so E2EE is not really needed then as I control both end and the server.