I call bias the net loss of entropy, which is what we care about, and not the deviation from the mean. In that sense, 51/49 is already a 2% bias, out of a big fat coin that's nothing like what you have in your pocket.
And no, it doesn't diminishes over turns: it's a whole 2% entropy loss on your fi...