Yes, the party that holds the redeemed note can withdraw unilaterally.
The note lifecycle is: purchase -> assign -> redeem -> withdraw. Each step changes the party, and this party can perform the next step.
Exit happens at withdrawal. The number of parties that can withdraw (and can be the recipie...