There is no extension to monitor swarm. You can still install machine agent in the docker host machine or as a container. I haven't tried this though.
Also, please refer to this document for 1st class support for docker with Server Visibility feature.
... View more