I already did a nip on it a couple of weeks ago, almost exsctly similar mechanism, you can take a look:
https://github.com/nostr-protocol/nips/pull/2207
This is similar to how we are managing shared private events in calendar as well