[SOLVED] Hitting a 500 Internal Server Error caused by unsupported protocol scheme \"\" with a file config

ciao there,

i have to run a setup where træfik is running in a Docker managed container and use it as a proxy to a service that runs on the host.

Configuration

docker-compose.yml (for træfik)

version: "3.8"

services:
  webproxy:
    image: traefik:v2.4
    restart: unless-stopped
    userns_mode: host
    networks:
      - webgateway
    ports:
      - "0.0.0.0:80:80"
      - "0.0.0.0:443:443"
    extra_hosts:
      - "host.docker.internal:host-gateway"
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock:ro
      - ${ACME_STORAGE}:/acme.json
      - ./traefik.toml:/traefik.toml:ro
      - ./traefik.conf.d:/etc/traefik.conf.d:ro

networks:
  webgateway:
    external:
      name: webgateway

/traefik.toml

[accessLog]


[certificatesResolvers.defaultacme.acme]
  email = "user@example.org"
  storage = "/acme.json"

  [certificatesResolvers.defaultacme.acme.tlsChallenge]


[entryPoints]

  [entryPoints.http]
    address = ":80"
    [entryPoints.http.http.redirections.entryPoint]
      scheme = "https"
      to = "https"

  [entryPoints.https]
    address = ":443"
    [entryPoints.https.http.tls]
      certResolver = "defaultacme"

[providers.docker]
  endpoint = "unix:///var/run/docker.sock"
  exposedByDefault = false
  network = "webgateway"
  watch = true


[providers.file]
  directory = "/etc/traefik.conf.d"
  watch = true


[tls.options.default]
  minVersion = "VersionTLS13"

[log]
  level = "DEBUG"

/etc/traefik.conf.d/service.toml

[http]

  [http.routers]

    [http.routers.test]
      rule = "Host(`test.example.org`)"
      service = "test-service"

  [http.services]

    [http.services.test-service]
      [http.services.seahub.loadBalancer]
        [http.services.seahub.loadBalancer.servers]
          url = "http://host.docker.internal:8000"

Troubleshooting

i run a simple http server as test service:

$ echo "Hello world!" > index.html
$ python3 -m http.server 8000
Serving HTTP on 0.0.0.0 port 8000 (http://0.0.0.0:8000/) ...

that responds to requests from the host itself:

$ curl http://localhost:8000/
Hello world!

and also to a client in the træfik container:

$ docker-compose exec webproxy curl http://host.docker.internal:8000/
Hello world!

but through træfik, this is the response:

$ curl https://seafile-test.moa.hu-berlin.de/
Internal Server Error

while it logs:

time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.example.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.example.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38532\",\"RequestURI\":\"/\",\"TLS\":null}"
time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: Forwarding this request to URL" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.example.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.example.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38532\",\"RequestURI\":\"/\",\"TLS\":null}" ForwardURL=
time="2021-05-04T15:04:33Z" level=debug msg="'500 Internal Server Error' caused by: unsupported protocol scheme \"\""
time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.example.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.example.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38532\",\"RequestURI\":\"/\",\"TLS\":null}"
11.22.33.44 - - [04/May/2021:15:04:33 +0000] "GET / HTTP/2.0" 500 21 "-" "-" 5 "https-test@file" "-" 0ms

Help?

can anyone point me to what i may be missing?
does anyone have a hint where that empty string that represents a scheme is stemming from?

fwiw, the behaviour is the same when i leave out the http-to-https-redirect. i also replaced traefik with an nginx in the otherwise same context, everything works as expected in this case.

Hello @funkyfuture,

could you provide your full traefik log from the beginning ?

ciao @jbd, yes, note that this also contains bits of a second service that i didn't show in the config above, as the metrics for Prometheus.

time="2021-05-04T14:45:47Z" level=info msg="Configuration loaded from file: /traefik.toml"
time="2021-05-04T14:45:47Z" level=info msg="Traefik version 2.4.8 built on 2021-03-23T15:48:39Z"
time="2021-05-04T14:45:47Z" level=debug msg="Static configuration loaded {\"global\":{\"checkNewVersion\":true},\"serversTransport\":{\"maxIdleConnsPerHost\":200},\"entryPoints\":{\"http\":{\"address\":\":80\",\"transport\":{\"lifeCycle\":{\"graceTimeOut\":10000000000},\"respondingTimeouts\":{\"idleTimeout\":180000000000}},\"forwardedHeaders\":{},\"http\":{\"redirections\":{\"entryPoint\":{\"to\":\"https\",\"scheme\":\"https\",\"permanent\":true,\"priority\":2147483646}}}},\"https\":{\"address\":\":443\",\"transport\":{\"lifeCycle\":{\"graceTimeOut\":10000000000},\"respondingTimeouts\":{\"idleTimeout\":180000000000}},\"forwardedHeaders\":{},\"http\":{\"tls\":{\"certResolver\":\"defaultacme\"}}},\"metrics\":{\"address\":\":9110\",\"transport\":{\"lifeCycle\":{\"graceTimeOut\":10000000000},\"respondingTimeouts\":{\"idleTimeout\":180000000000}},\"forwardedHeaders\":{},\"http\":{}}},\"providers\":{\"providersThrottleDuration\":2000000000,\"docker\":{\"watch\":true,\"endpoint\":\"unix:///var/run/docker.sock\",\"defaultRule\":\"Host(`{{ normalize .Name }}`)\",\"network\":\"webgateway\",\"swarmModeRefreshSeconds\":15000000000},\"file\":{\"directory\":\"/etc/traefik.conf.d\",\"watch\":true}},\"metrics\":{\"prometheus\":{\"buckets\":[0.1,0.3,1.2,5],\"addEntryPointsLabels\":true,\"addServicesLabels\":true,\"entryPoint\":\"metrics\"}},\"log\":{\"level\":\"DEBUG\",\"format\":\"common\"},\"accessLog\":{\"format\":\"common\",\"filters\":{},\"fields\":{\"defaultMode\":\"keep\",\"headers\":{\"defaultMode\":\"drop\"}}},\"certificatesResolvers\":{\"defaultacme\":{\"acme\":{\"email\":\"user@example.org\",\"caServer\":\"https://acme-v02.api.letsencrypt.org/directory\",\"storage\":\"/acme.json\",\"keyType\":\"RSA4096\",\"tlsChallenge\":{}}}},\"pilot\":{\"dashboard\":true}}"
time="2021-05-04T14:45:47Z" level=info msg="\nStats collection is disabled.\nHelp us improve Traefik by turning this feature on :)\nMore details on: https://doc.traefik.io/traefik/contributing/data-collection/\n"
time="2021-05-04T14:45:47Z" level=debug msg="Configured Prometheus metrics" metricsProviderName=prometheus
time="2021-05-04T14:45:47Z" level=debug msg="Start TCP Server" entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Start TCP Server" entryPointName=http
time="2021-05-04T14:45:47Z" level=info msg="Starting provider aggregator.ProviderAggregator {}"
time="2021-05-04T14:45:47Z" level=debug msg="Start TCP Server" entryPointName=https
time="2021-05-04T14:45:47Z" level=info msg="Starting provider *file.Provider {\"directory\":\"/etc/traefik.conf.d\",\"watch\":true}"
time="2021-05-04T14:45:47Z" level=info msg="Starting provider *traefik.Provider {}"
time="2021-05-04T14:45:47Z" level=info msg="Starting provider *docker.Provider {\"watch\":true,\"endpoint\":\"unix:///var/run/docker.sock\",\"defaultRule\":\"Host(`{{ normalize .Name }}`)\",\"network\":\"webgateway\",\"swarmModeRefreshSeconds\":15000000000}"
time="2021-05-04T14:45:47Z" level=info msg="Starting provider *acme.ChallengeTLSALPN {\"Timeout\":4000000000}"
time="2021-05-04T14:45:47Z" level=info msg="Starting provider *acme.Provider {\"email\":\"user@example.org\",\"caServer\":\"https://acme-v02.api.letsencrypt.org/directory\",\"storage\":\"/acme.json\",\"keyType\":\"RSA4096\",\"tlsChallenge\":{},\"ResolverName\":\"defaultacme\",\"store\":{},\"TLSChallengeProvider\":{\"Timeout\":4000000000},\"HTTPChallengeProvider\":{}}"
time="2021-05-04T14:45:47Z" level=info msg="Testing certificate renew..." providerName=defaultacme.acme
time="2021-05-04T14:45:47Z" level=debug msg="Configuration received from provider file: {\"http\":{\"routers\":{\"otha\":{\"middlewares\":[\"othaPathPrefix\"],\"service\":\"otha\",\"rule\":\"Host(`test.exmaple.org`) \\u0026\\u0026 PathPrefix(`/prefix/`)\"},\"test\":{\"service\":\"test-service\",\"rule\":\"Host(`test.exmaple.org`)\"}},\"services\":{\"otha\":{\"loadBalancer\":{\"servers\":[{}],\"passHostHeader\":true}},\"test-service\":{\"loadBalancer\":{\"servers\":[{}],\"passHostHeader\":true}}},\"middlewares\":{\"othaPathPrefix\":{\"stripPrefix\":{\"prefixes\":[\"/prefix\"],\"forceSlash\":true}}}},\"tcp\":{},\"udp\":{},\"tls\":{}}" providerName=file
time="2021-05-04T14:45:47Z" level=debug msg="Configuration received from provider internal: {\"http\":{\"routers\":{\"http-to-https\":{\"entryPoints\":[\"http\"],\"middlewares\":[\"redirect-http-to-https\"],\"service\":\"noop@internal\",\"rule\":\"HostRegexp(`{host:.+}`)\",\"priority\":2147483646},\"prometheus\":{\"entryPoints\":[\"metrics\"],\"service\":\"prometheus@internal\",\"rule\":\"PathPrefix(`/metrics`)\",\"priority\":2147483647}},\"services\":{\"noop\":{},\"prometheus\":{}},\"middlewares\":{\"redirect-http-to-https\":{\"redirectScheme\":{\"scheme\":\"https\",\"port\":\"443\",\"permanent\":true}}},\"models\":{\"https\":{\"tls\":{\"certResolver\":\"defaultacme\"}}},\"serversTransports\":{\"default\":{\"maxIdleConnsPerHost\":200}}},\"tcp\":{},\"tls\":{}}" providerName=internal
time="2021-05-04T14:45:47Z" level=debug msg="No entryPoint defined for this router, using the default one(s) instead: [http https metrics]" routerName=test
time="2021-05-04T14:45:47Z" level=debug msg="Configuration received from provider defaultacme.acme: {\"http\":{},\"tls\":{}}" providerName=defaultacme.acme
time="2021-05-04T14:45:47Z" level=debug msg="No entryPoint defined for this router, using the default one(s) instead: [http https metrics]" routerName=otha
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware prometheus@internal" entryPointName=metrics routerName=prometheus@internal middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" routerName=otha@file serviceName=otha middlewareName=pipelining middlewareType=Pipelining entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=otha middlewareName=metrics-service middlewareType=Metrics entryPointName=metrics routerName=otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=metrics routerName=otha@file serviceName=otha
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " serviceName=otha entryPointName=metrics routerName=otha@file serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware otha" middlewareType=TracingForwarder entryPointName=metrics routerName=otha@file middlewareName=tracing
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=StripPrefix middlewareName=othaPathPrefix@file entryPointName=metrics routerName=otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" entryPointName=metrics routerName=otha@file middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=test-service middlewareName=pipelining middlewareType=Pipelining routerName=test@file entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=Metrics middlewareName=metrics-service routerName=test@file entryPointName=metrics serviceName=test-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" serviceName=test-service routerName=test@file entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " routerName=test@file entryPointName=metrics serviceName=test-service serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware test" entryPointName=metrics routerName=test@file middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=traefik-internal-recovery middlewareType=Recovery entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware noop@internal" routerName=http-to-https@internal middlewareName=tracing middlewareType=TracingForwarder entryPointName=http
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=RedirectScheme entryPointName=http routerName=http-to-https@internal middlewareName=redirect-http-to-https@internal
time="2021-05-04T14:45:47Z" level=debug msg="Setting up redirection to https 443" middlewareName=redirect-http-to-https@internal middlewareType=RedirectScheme entryPointName=http routerName=http-to-https@internal
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" middlewareName=redirect-http-to-https@internal entryPointName=http routerName=http-to-https@internal
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http middlewareType=Recovery middlewareName=traefik-internal-recovery
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=metrics-entrypoint middlewareType=Metrics entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" routerName=https-otha@file serviceName=otha middlewareName=pipelining middlewareType=Pipelining entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https routerName=https-otha@file serviceName=otha middlewareType=Metrics middlewareName=metrics-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=https routerName=https-otha@file serviceName=otha
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " serviceName=otha serverName=0 entryPointName=https routerName=https-otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware otha" entryPointName=https routerName=https-otha@file middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https routerName=https-otha@file middlewareName=othaPathPrefix@file middlewareType=StripPrefix
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" entryPointName=https routerName=https-otha@file middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=test-service middlewareName=pipelining middlewareType=Pipelining entryPointName=https routerName=https-test@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=metrics-service middlewareType=Metrics entryPointName=https routerName=https-test@file serviceName=test-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=https routerName=https-test@file serviceName=test-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " entryPointName=https routerName=https-test@file serviceName=test-service serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware test" middlewareName=tracing middlewareType=TracingForwarder entryPointName=https routerName=https-test@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=traefik-internal-recovery middlewareType=Recovery entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=metrics middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=metrics-entrypoint middlewareType=Metrics entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:47Z" level=debug msg="Provider connection established with docker 20.10.6 (API 1.41)" providerName=docker
time="2021-05-04T14:45:47Z" level=debug msg="Filtering disabled container" providerName=docker container=webproxy-traefik-466a3d99e9b4a59af75e70ad9d757bd84e3c30bc6ece1f658dd42e49ed006086
time="2021-05-04T14:45:47Z" level=debug msg="Configuration received from provider docker: {\"http\":{},\"tcp\":{},\"udp\":{}}" providerName=docker
time="2021-05-04T14:45:47Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:47Z" level=debug msg="Adding route for test.exmaple.org with TLS options default" entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Adding certificate for domain(s) test.exmaple.org"
time="2021-05-04T14:45:47Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" providerName=defaultacme.acme routerName=https-otha@file rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)"
time="2021-05-04T14:45:47Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:47Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:47Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." providerName=defaultacme.acme routerName=https-otha@file rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)"
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware noop@internal" middlewareType=TracingForwarder entryPointName=http routerName=http-to-https@internal middlewareName=tracing
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http routerName=http-to-https@internal middlewareName=redirect-http-to-https@internal middlewareType=RedirectScheme
time="2021-05-04T14:45:47Z" level=debug msg="Setting up redirection to https 443" middlewareType=RedirectScheme entryPointName=http routerName=http-to-https@internal middlewareName=redirect-http-to-https@internal
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" routerName=http-to-https@internal entryPointName=http middlewareName=redirect-http-to-https@internal
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=otha middlewareName=pipelining middlewareType=Pipelining entryPointName=http routerName=otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http routerName=otha@file serviceName=otha middlewareName=metrics-service middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=http routerName=otha@file serviceName=otha
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " entryPointName=http routerName=otha@file serviceName=otha serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware otha" routerName=otha@file middlewareName=tracing middlewareType=TracingForwarder entryPointName=http
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=StripPrefix entryPointName=http routerName=otha@file middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" routerName=otha@file middlewareName=othaPathPrefix@file entryPointName=http
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=test-service entryPointName=http routerName=test@file middlewareName=pipelining middlewareType=Pipelining
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" serviceName=test-service middlewareName=metrics-service middlewareType=Metrics entryPointName=http routerName=test@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=http routerName=test@file serviceName=test-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " serviceName=test-service serverName=0 entryPointName=http routerName=test@file
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware test" routerName=test@file middlewareName=tracing middlewareType=TracingForwarder entryPointName=http
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=traefik-internal-recovery middlewareType=Recovery entryPointName=http
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware prometheus@internal" middlewareType=TracingForwarder entryPointName=metrics routerName=prometheus@internal middlewareName=tracing
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=Recovery entryPointName=metrics middlewareName=traefik-internal-recovery
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=metrics-entrypoint middlewareType=Metrics entryPointName=metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https routerName=https-test@file serviceName=test-service middlewareName=pipelining middlewareType=Pipelining
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https routerName=https-test@file serviceName=test-service middlewareType=Metrics middlewareName=metrics-service
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" serviceName=test-service entryPointName=https routerName=https-test@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " entryPointName=https routerName=https-test@file serviceName=test-service serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware test" routerName=https-test@file middlewareName=tracing middlewareType=TracingForwarder entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" routerName=https-otha@file serviceName=otha middlewareName=pipelining middlewareType=Pipelining entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareName=metrics-service middlewareType=Metrics serviceName=otha entryPointName=https routerName=https-otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating load-balancer" entryPointName=https routerName=https-otha@file serviceName=otha
time="2021-05-04T14:45:47Z" level=debug msg="Creating server 0 " entryPointName=https routerName=https-otha@file serviceName=otha serverName=0
time="2021-05-04T14:45:47Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." providerName=defaultacme.acme routerName=https-otha@file rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)"
time="2021-05-04T14:45:47Z" level=debug msg="Added outgoing tracing middleware otha" routerName=https-otha@file middlewareName=tracing middlewareType=TracingForwarder entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" routerName=https-otha@file middlewareName=othaPathPrefix@file middlewareType=StripPrefix entryPointName=https
time="2021-05-04T14:45:47Z" level=debug msg="Adding tracing to middleware" middlewareName=othaPathPrefix@file entryPointName=https routerName=https-otha@file
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" middlewareType=Recovery entryPointName=https middlewareName=traefik-internal-recovery
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=metrics middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="Creating middleware" entryPointName=https middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:47Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:47Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:48Z" level=debug msg="Adding route for test.exmaple.org with TLS options default" entryPointName=https
time="2021-05-04T14:45:48Z" level=debug msg="Adding certificate for domain(s) test.exmaple.org"
time="2021-05-04T14:45:48Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:48Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)" providerName=defaultacme.acme routerName=https-otha@file
time="2021-05-04T14:45:48Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:48Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." routerName=https-otha@file rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)" providerName=defaultacme.acme
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware noop@internal" middlewareType=TracingForwarder routerName=http-to-https@internal entryPointName=http middlewareName=tracing
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" routerName=http-to-https@internal entryPointName=http middlewareName=redirect-http-to-https@internal middlewareType=RedirectScheme
time="2021-05-04T14:45:48Z" level=debug msg="Setting up redirection to https 443" middlewareName=redirect-http-to-https@internal middlewareType=RedirectScheme routerName=http-to-https@internal entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Adding tracing to middleware" entryPointName=http routerName=http-to-https@internal middlewareName=redirect-http-to-https@internal
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=http routerName=otha@file serviceName=otha middlewareType=Pipelining middlewareName=pipelining
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=http routerName=otha@file serviceName=otha middlewareName=metrics-service middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating load-balancer" routerName=otha@file serviceName=otha entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Creating server 0 " routerName=otha@file serviceName=otha serverName=0 entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware otha" routerName=otha@file middlewareName=tracing middlewareType=TracingForwarder entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareType=StripPrefix routerName=otha@file entryPointName=http middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:48Z" level=debug msg="Adding tracing to middleware" entryPointName=http routerName=otha@file middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareName=pipelining middlewareType=Pipelining routerName=test@file serviceName=test-service entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareType=Metrics entryPointName=http routerName=test@file serviceName=test-service middlewareName=metrics-service
time="2021-05-04T14:45:48Z" level=debug msg="Creating load-balancer" routerName=test@file serviceName=test-service entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Creating server 0 " routerName=test@file serviceName=test-service serverName=0 entryPointName=http
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware test" entryPointName=http routerName=test@file middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=traefik-internal-recovery middlewareType=Recovery
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware prometheus@internal" entryPointName=metrics routerName=prometheus@internal middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareName=traefik-internal-recovery middlewareType=Recovery entryPointName=metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareName=metrics-entrypoint entryPointName=metrics middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=http middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareName=metrics-entrypoint middlewareType=Metrics entryPointName=https
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" serviceName=test middlewareName=pipelining middlewareType=Pipelining entryPointName=https routerName=https-test@file
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" serviceName=test entryPointName=https routerName=https-test@file middlewareName=metrics-service middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating load-balancer" entryPointName=https routerName=https-test@file serviceName=test-service
time="2021-05-04T14:45:48Z" level=debug msg="Creating server 0 " serviceName=test-service serverName=0 entryPointName=https routerName=https-test@file
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware test" routerName=https-test@file entryPointName=https middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=https routerName=https-otha@file middlewareName=pipelining middlewareType=Pipelining serviceName=otha
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" middlewareType=Metrics middlewareName=metrics-service entryPointName=https routerName=https-otha@file serviceName=otha
time="2021-05-04T14:45:48Z" level=debug msg="Creating load-balancer" serviceName=otha entryPointName=https routerName=https-otha@file
time="2021-05-04T14:45:48Z" level=debug msg="Creating server 0 " serverName=0 entryPointName=https routerName=https-otha@file serviceName=otha
time="2021-05-04T14:45:48Z" level=debug msg="Added outgoing tracing middleware otha" entryPointName=https routerName=https-otha@file middlewareName=tracing middlewareType=TracingForwarder
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" routerName=https-otha@file middlewareName=othaPathPrefix@file middlewareType=StripPrefix entryPointName=https
time="2021-05-04T14:45:48Z" level=debug msg="Adding tracing to middleware" entryPointName=https routerName=https-otha@file middlewareName=othaPathPrefix@file
time="2021-05-04T14:45:48Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." routerName=https-otha@file rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)" providerName=defaultacme.acme
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=https middlewareType=Recovery middlewareName=traefik-internal-recovery
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=metrics middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=http middlewareType=Metrics middlewareName=metrics-entrypoint
time="2021-05-04T14:45:48Z" level=debug msg="Creating middleware" entryPointName=https middlewareName=metrics-entrypoint middlewareType=Metrics
time="2021-05-04T14:45:48Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." routerName=https-test@file rule="Host(`test.exmaple.org`)" providerName=defaultacme.acme
time="2021-05-04T14:45:48Z" level=debug msg="No default certificate, generating one"
time="2021-05-04T14:45:48Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:48Z" level=debug msg="Adding route for test.exmaple.org with TLS options default" entryPointName=https
time="2021-05-04T14:45:48Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)" routerName=https-otha@file providerName=defaultacme.acme
time="2021-05-04T14:45:48Z" level=debug msg="Try to challenge certificate for domain [test.exmaple.org] found in HostSNI rule" rule="Host(`test.exmaple.org`)" providerName=defaultacme.acme routerName=https-test@file
time="2021-05-04T14:45:48Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." routerName=https-test@file rule="Host(`test.exmaple.org`)" providerName=defaultacme.acme
time="2021-05-04T14:45:48Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." providerName=defaultacme.acme routerName=https-test@file rule="Host(`test.exmaple.org`)"
time="2021-05-04T14:45:48Z" level=debug msg="Looking for provided certificate(s) to validate [\"test.exmaple.org\"]..." routerName=https-otha@file providerName=defaultacme.acme rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)"
time="2021-05-04T14:45:48Z" level=debug msg="No ACME certificate generation required for domains [\"test.exmaple.org\"]." rule="Host(`test.exmaple.org`) && PathPrefix(`/prefix/`)" routerName=https-otha@file providerName=defaultacme.acme

and here's the rest due to the message size limit here.

time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"Upgrade-Insecure-Requests\":[\"1\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/\",\"TLS\":null}"
time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: Forwarding this request to URL" ForwardURL= Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"Upgrade-Insecure-Requests\":[\"1\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/\",\"TLS\":null}"
time="2021-05-04T14:46:49Z" level=debug msg="'500 Internal Server Error' caused by: unsupported protocol scheme \"\""
time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"Upgrade-Insecure-Requests\":[\"1\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/\",\"TLS\":null}"
11.22.33.44 - - [04/May/2021:14:46:49 +0000] "GET / HTTP/2.0" 500 21 "-" "-" 1 "https-test@file" "-" 2ms
time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/favicon.ico\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"image/webp,*/*\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Referer\":[\"https://test.exmaple.org/\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/favicon.ico\",\"TLS\":null}"
time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: Forwarding this request to URL" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/favicon.ico\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"image/webp,*/*\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Referer\":[\"https://test.exmaple.org/\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/favicon.ico\",\"TLS\":null}" ForwardURL=
time="2021-05-04T14:46:49Z" level=debug msg="'500 Internal Server Error' caused by: unsupported protocol scheme \"\""
time="2021-05-04T14:46:49Z" level=debug msg="vulcand/oxy/roundrobin/rr: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/favicon.ico\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"image/webp,*/*\"],\"Accept-Encoding\":[\"gzip, deflate, br\"],\"Accept-Language\":[\"de,en-US;q=0.7,en;q=0.3\"],\"Cache-Control\":[\"no-cache\"],\"Dnt\":[\"1\"],\"Pragma\":[\"no-cache\"],\"Referer\":[\"https://test.exmaple.org/\"],\"Sec-Gpc\":[\"1\"],\"Te\":[\"trailers\"],\"User-Agent\":[\"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:88.0) Gecko/20100101 Firefox/88.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"11.22.33.44\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"11.22.33.44:38784\",\"RequestURI\":\"/favicon.ico\",\"TLS\":null}"
11.22.33.44 - - [04/May/2021:14:46:49 +0000] "GET /favicon.ico HTTP/2.0" 500 21 "-" "-" 2 "https-test@file" "-" 1ms
time="2021-05-04T15:03:02Z" level=debug msg="Serving default certificate for request: \"\""
167.248.133.54 - - [04/May/2021:15:03:03 +0000] "GET / HTTP/1.1" 404 19 "-" "-" 3 "-" "-" 0ms
time="2021-05-04T15:03:04Z" level=debug msg="Serving default certificate for request: \"\""
167.248.133.54 - - [04/May/2021:15:03:04 +0000] "GET / HTTP/1.1" 404 19 "-" "-" 4 "-" "-" 0ms
time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: begin ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"55.66.77.88\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"55.66.77.88:38532\",\"RequestURI\":\"/\",\"TLS\":null}"
time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: Forwarding this request to URL" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"55.66.77.88\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"55.66.77.88:38532\",\"RequestURI\":\"/\",\"TLS\":null}" ForwardURL=
time="2021-05-04T15:04:33Z" level=debug msg="'500 Internal Server Error' caused by: unsupported protocol scheme \"\""
time="2021-05-04T15:04:33Z" level=debug msg="vulcand/oxy/roundrobin/rr: completed ServeHttp on request" Request="{\"Method\":\"GET\",\"URL\":{\"Scheme\":\"\",\"Opaque\":\"\",\"User\":null,\"Host\":\"\",\"Path\":\"/\",\"RawPath\":\"\",\"ForceQuery\":false,\"RawQuery\":\"\",\"Fragment\":\"\",\"RawFragment\":\"\"},\"Proto\":\"HTTP/2.0\",\"ProtoMajor\":2,\"ProtoMinor\":0,\"Header\":{\"Accept\":[\"*/*\"],\"User-Agent\":[\"curl/7.68.0\"],\"X-Forwarded-Host\":[\"test.exmaple.org\"],\"X-Forwarded-Port\":[\"443\"],\"X-Forwarded-Proto\":[\"https\"],\"X-Forwarded-Server\":[\"466a3d99e9b4\"],\"X-Real-Ip\":[\"55.66.77.88\"]},\"ContentLength\":0,\"TransferEncoding\":null,\"Host\":\"test.exmaple.org\",\"Form\":null,\"PostForm\":null,\"MultipartForm\":null,\"Trailer\":null,\"RemoteAddr\":\"55.66.77.88:38532\",\"RequestURI\":\"/\",\"TLS\":null}"
55.66.77.88 - - [04/May/2021:15:04:33 +0000] "GET / HTTP/2.0" 500 21 "-" "-" 5 "https-test@file" "-" 0ms

At first glance, it seems that there are some configuration errors.

You don't have any servers in your load balancer, it seems to be related to the service.toml configuration, the servers must be defined as an array:

    [http.services.test-service]
      [http.services.seahub.loadBalancer]
        [[http.services.seahub.loadBalancer.servers]]
          url = "http://host.docker.internal:8000"

Then, we can see "rule": "Host(`test.exmaple.org`)" in the log that could lead to another issue of routing as the host rule does not match the request you are trying to do :wink:
Could you fix it and try again?

thank you very much. indeed it was one configuration error, everything else is due to my faulty redaction of the provided data.

do you think the configuration validation can be improved to spot a single table where an array of such is expected? shall i open a feature request for that? or shall i submit a proposal to amend a hint/warning to the service configuration section in the docs?

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.