An actual cork? It won't last as long, and may not be quite as secure, but even as it degrades I don't think cork has been linked to any issues, given centuries (millenia?) of use with wine.

It may make people think you're a wino though.