Traefik listens on node port regardless of service being ClusterIp or not

On our current cluster (rke2), it seems that the nginx ingress controller is not exposed through a NodePort by default. Instead, it uses a ClusterIP Service and relies on the CNI to route incoming requests to the ingress controller.
We are thinking of switching the ingress controller to traefik but want to keep the same behavior regarding port usage.
But we found that even if we set the service type as ClusterIP, traefik seems to still listen on node port 80 and 443 regardlessly.
So wondering if there is a way to turn off this behavior as we are having other process running on the host that use the port.