Error while updating to Traefik version 2.9.9

Traefik Traefik v2 (latest)
1

We are upgrading traefik version from 2.9.8 to 2.9.9.

While upgrading, we are receiving error in logs

{"ACME CA":"[https://acme-v02.api.letsencrypt.org/directory","level":"error","msg":"Unable](https://acme-v02.api.letsencrypt.org/directory%22,%22level%22:%22error%22,%22msg%22:%22Unable) to obtain ACME certificate for domains \"domain.com\": unable to generate a certificate for the domains [domain.com]: acme: error: 429 :: POST :: https://acme-v02.api.letsencrypt.org/acme/new-order :: urn:ietf:params:acme:error:rateLimited :: Error creating new order :: too many failed authorizations recently: see [https://letsencrypt.org/docs/failed-validation-limit/","providerName":"le.acme","routerName":"traefik-forward-authserverhttps-ae666fdd12603d0225d0@kubernetescrd","rule":"Host(`domain.com`)","time":"2023-04-17T07:29:05Z"}](https://letsencrypt.org/docs/failed-validation-limit/%22,%22providerName%22:%22le.acme%22,%22routerName%22:%22traefik-forward-authserverhttps-ae666fdd12603d0225d0@kubernetescrd%22,%22rule%22:%22Host(%60domain.com%60)%22,%22time%22:%222023-04-17T07:29:05Z%22%7D)

Also our Pod is going in crashloop please refer below screen shot

Can anyone guide me on this, as iam new for traefik

2

Message is clear, you hit LE limits, which is a pain:

Check the logs why Traefik is restarting. Make sure you persist any retrieved LE certs to avoid hitting limits.

Usually a separate cert manager is used with Traefik in k8s for "distributed LE“, when using multiple Traefik instances in parallel.