A bootable USB OS makes much more sense than a portable binary, nice. Tails is a good reference for exactly what you describe: unplugging the stick triggers an emergency shutdown, and the data in RAM is securely erased against cold boot attacks. Worth reading how they do it.
A few things that help ...