Just have them read out their seed phrase over the phone, the person will never remember it, and then you maintain the privacy of your stack and how much you have.
Poor security isn't like poor nutrition, it won't kill you, but it might take your stack.