Thanks for the solution! I was going crazy trying to fix it.
I would be nice to have a better solution built in to Traefik to fix this kind of problem and make setup more similar to how Nginx behaves by default.
I had exact same issue: Cannot reacreate Nginx proxy_pass behavior with Traefik