Your Docker setup is probably sharing root access with your host machine, and that's far from ideal for a self-hosting server ...
There's no point in wasting GPU resources on VMs when LXCs can share the same card ...