If you are not the one who is managing the encryption keys it is not a secure end to end messaging. For example matrix synapse, keys are only on the client device, can be exported as a backup. But without them not even the server knows what messages are about. With rcs doesn't look like you are in control of the keys. Not your keys....