That one has no firewall rules so I am not sure. I tested this once some time ago and it worked as expected, closing the connection when the vpn dropdown
https://github.com/binhex/arch-delugevpn
Also if you have a router with openwrt is very easy using multiwan.