Could you set up spark to run as a local service ( on another port and even potentially in a docker image ?
I’m not sure. It is a L2
1