I use diluted peppermint oil + water in a spray bottle and go full-bore on any territories where wasps and other angry/non-pollinator bees hang out. Also on my doorway outside. They hate mint.
I'll have to keep this in mind. For now they seem to be hanging out on the flowers.
1