Found it! Actually the versionCode part was missing in the version string. With no +, Flutter sets FLUTTER_BUILD_NUMBER to the whole version string, and Android falls back to "1".
I will release a fix, thank you for pointing me on the right direction!