Having the seed phrase laying around is a bad idea unless your passphrase is at least 128 bits secure.
The evil maid can steal the phrase and take her time bruteforcing the wallet.