Using Traefik happily for 5 years in Swarm without limits.
But of course it makes sense to use it for security and a new Traefik version might introduce a memory consuming bug, then you are more in the safe side.
I think the usual bugs manifest in simply not working or eating memory. That might impact other services on the same machine. Setting a memory limit would probably restart the faulty container at some point.