Getting 502 error behind Traefik reverse proxy

[saul-salazar-dotcom]

I cannot get it to work when deploying biniou behind a reverse proxy like Traefik

$ docker logs ai-biniou-1
>>>[biniou 🧠]: Detected TCMalloc_minimal installation : using it.
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.
0it [00:00, ?it/s]
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.1.0+cu121 with CUDA 1201 (you have 2.1.0+cpu)
    Python  3.11.6 (you have 3.11.2)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
>>>[biniou 🧠]: Up and running at https://192.168.32.3:7860
breaking-glass-b74m9uy5@ds-general-dev:/opt/apps/ai$ docker logs ai-biniou-1
>>>[biniou 🧠]: Detected TCMalloc_minimal installation : using it.
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.1.0+cu121 with CUDA 1201 (you have 2.1.0+cpu)
    Python  3.11.6 (you have 3.11.2)
  Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers)
  Memory-efficient attention, SwiGLU, sparse and more won't be available.
  Set XFORMERS_MORE_DETAILS=1 for more details
>>>[biniou 🧠]: Up and running at https://192.168.32.5:7860
IMPORTANT: You are using gradio version 3.50.2, however version 4.44.1 is available, please upgrade.

example compose file:

services:
  biniou:
    image: ghcr.io/woolverine94/biniou:main
    restart: unless-stopped
    networks:
      - default
      - proxy
    volumes:
      - biniou-outputs:/home/biniou/biniou/outputs
      - biniou-models:/home/biniou/biniou/models
      - biniou-cache:/home/biniou/.cache/huggingface
      - biniou-gfpgan:/home/biniou/biniou/gfpgan
    labels:
      - traefik.enable=true
      - traefik.http.routers.${COMPOSE_PROJECT_NAME}-genai.tls=true
      - traefik.http.routers.${COMPOSE_PROJECT_NAME}-genai.entrypoints=https
      - traefik.http.routers.${COMPOSE_PROJECT_NAME}-genai.rule=Host(`genai.domain.com`)
      - traefik.http.services.${COMPOSE_PROJECT_NAME}-genai.loadbalancer.server.port=7860

[Woolverine94]

Hello @saul-salazar-dotcom,

First of all, thanks for you interest in biniou.

It's pretty hard for me to help you diagnosis this error, as a 502 bad gateway can be caused by several issues, most of them out of the scope of the biniou container itself. Moreover, I'm not familiar with traefik.

Two things you can try to help the diagnosis :

• Accessing the container from inside your network, without passing by the reverse proxy (e.g. : https://192.168.32.5:7860 )
• Try to replace the biniou container by another one (like a basic web server, for example).

If you can access locally biniou, but also get the 502 error with another container, there's probably not much I can do to help you.

Also, does the biniou console threw further errors when you try to access it and gets this 502 error ?

Best regards,

[UntouchedWagons]

It's because traefik is trying to communicate with biniou over HTTP but biniou is expecting HTTPS. Add this to your labels:

- traefik.http.services.${COMPOSE_PROJECT_NAME}-genai.loadbalancer.server.scheme=https

And it'll work

[Woolverine94]

@UntouchedWagons,

Thanks for the tip !