The correct term is "eat your cake and have it too" but for some reason everyone uses it backwards
Right, it's meant to imply the backwards nature of the thing.