Error accessing docker api via tcp

Traefik Traefik v2
,
1

Hello all,

I am currently having problem accesing the docker API via tcp from another host.

Here is my .yml file:

version: "3.3"

services:

  traefik:
    image: "traefik:v2.8"
    container_name: "traefik"
    command:
      #- "--log.level=DEBUG"
      - "--api.insecure=true"
      - "--entrypoints.web.address=:80"
      - "--providers.docker.swarmMode=true"
      - "--providers.docker.endpoint=tcp://[SERVERIP]:2377"
    ports:
      - "80:80"
      - "8080:8080"

This is the infrastructure setup:

###################                                     ##################
#docker-swarm-node1#   <----------------------->  #traefik-docker-host1#
###################                                     ##################

###################
#docker-swarm-node2# 
###################

###################
#docker-swarm-node3# 
###################

All of the docker swarm nodes (1-3) are manager + woker node at the same time. I run traefik on a seperat host.

After deploying the .yml file on traefik-docker-host1 I see the following error:

traefik  | time="2022-08-16T08:44:18Z" level=error msg="Provider connection error error during connect: Get \"http://[IPADRESS]:2377/v1.24/version\": EOF, retrying in 2.012706238s" providerName=docker

On the docker-swarm-node1 I see the following error:

Aug 16 10:44:20 docker-swarm-node1 dockerd[654]: time="2022-08-16T10:44:20.455261391+02:00" level=warning msg="grpc: Server.Serve failed to complete security handshake from "t[raefik-docker-host1]:50906": tls: first record does not look like a TLS handshake" module=grpc

Has someone bulid a similar setup and ran into the same error?

docker version is 20.10.14 and OS is PhotonOS from VMware for all Hosts.