Fatal error with docker on whisper-melo-llama3

[acastry]

Hello there is a fatal error when trying to deploy whisper-melo-llama3
First it is necessary to modify bolna_server.Dockerfile to get the last repository right ?
RUN pip install --force-reinstall git+https://github.com/bolna-ai/bolna@MeloTTS
to:
RUN pip install --force-reinstall git+https://github.com/bolna-ai/bolna@master

Then the fatal error i guess in MeloTTS :
` => [melo-app 5/10] RUN git clone https://github.com/bolna-ai/MeloTTS 2.1s
=> [melo-app 6/10] RUN pip install fastapi uvicorn torchaudio 46.9s
=> [bolna-app 12/14] RUN pip install pydub==0.25.1 1.6s
=> [bolna-app 13/14] RUN pip install ffprobe 2.7s
=> [bolna-app 14/14] RUN pip install aiofiles 1.3s
=> ERROR [bolna-app] exporting to docker image format 183.9s
=> => exporting layers 112.2s
=> => exporting manifest sha256:06c40a005b2f6040981b04d677a5994fa440a4b8b0a826bb7193ffae940856e5 0.0s
=> => exporting config sha256:89c37bae6f62aca0d4d57689610467537971fa097ea12c00147f3fc21cd900d5 0.0s
=> => sending tarball 71.7s
=> [melo-app 7/10] RUN cp -a MeloTTS/. . 0.7s
=> [melo-app 8/10] RUN python -m pip cache purge 0.8s
=> ERROR [melo-app 9/10] RUN pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykaka 147.7s
=> [whisper-app 9/12] RUN pip install git+https://github.com/SYSTRAN/faster-whisper.git 8.6s
=> [whisper-app 10/12] RUN pip install transformers 11.1s
=> [whisper-app 11/12] RUN ct2-transformers-converter --model openai/whisper-small --copy_files preprocessor_config.json --output_dir ./Server/ASR/whisper_small --quantization float16 33.0s
=> [whisper-app 12/12] WORKDIR Server 0.0s
=> CANCELED [whisper-app] exporting to docker image format 87.4s
=> => exporting layers 87.4s
=> CANCELED [bolna-app bolna-app] importing to docker 17.5s

[bolna-app] exporting to docker image format:

---

---

[melo-app 9/10] RUN pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykakasi==2.2.1 fugashi==1.3.0 g2p_en==2.1.0 anyascii==0.3.2 jamo==0.4.1 gruut[de,es,fr]==2.2.3 g2pkk>=0.1.1 librosa==0.9.1 pydub==0.25.1 eng_to_ipa==0.0.2 inflect==7.0.0 unidecode==1.3.7 pypinyin==0.50.0 cn2an==0.5.22 jieba==0.42.1 langid==1.1.6 tqdm tensorboard==2.16.2 loguru==0.7.2:
132.9 error: subprocess-exited-with-error
132.9
132.9 × python setup.py bdist_wheel did not run successfully.
132.9 │ exit code: 1
132.9 ╰─> [24 lines of output]
132.9 running bdist_wheel
132.9 running build
132.9 running build_py
132.9 creating build
132.9 creating build/lib.linux-aarch64-cpython-310
132.9 creating build/lib.linux-aarch64-cpython-310/pycrfsuite
132.9 copying pycrfsuite/_dumpparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
132.9 copying pycrfsuite/_logparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
132.9 copying pycrfsuite/init.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
132.9 running build_ext
132.9 building 'pycrfsuite._pycrfsuite' extension
132.9 creating build/temp.linux-aarch64-cpython-310
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf/src
132.9 creating build/temp.linux-aarch64-cpython-310/crfsuite/swig
132.9 creating build/temp.linux-aarch64-cpython-310/liblbfgs
132.9 creating build/temp.linux-aarch64-cpython-310/liblbfgs/lib
132.9 creating build/temp.linux-aarch64-cpython-310/pycrfsuite
132.9 gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/local/include/python3.10 -c -std=c99 crfsuite/lib/cqdb/src/cqdb.c -o build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src/cqdb.o
132.9 error: command 'gcc' failed: No such file or directory
132.9 [end of output]
132.9
132.9 note: This error originates from a subprocess, and is likely not a problem with pip.
132.9 ERROR: Failed building wheel for python-crfsuite
139.5 error: subprocess-exited-with-error
139.5
139.5 × Running setup.py install for python-crfsuite did not run successfully.
139.5 │ exit code: 1
139.5 ╰─> [26 lines of output]
139.5 running install
139.5 /usr/local/lib/python3.10/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
139.5 warnings.warn(
139.5 running build
139.5 running build_py
139.5 creating build
139.5 creating build/lib.linux-aarch64-cpython-310
139.5 creating build/lib.linux-aarch64-cpython-310/pycrfsuite
139.5 copying pycrfsuite/_dumpparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
139.5 copying pycrfsuite/_logparser.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
139.5 copying pycrfsuite/init.py -> build/lib.linux-aarch64-cpython-310/pycrfsuite
139.5 running build_ext
139.5 building 'pycrfsuite._pycrfsuite' extension
139.5 creating build/temp.linux-aarch64-cpython-310
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/lib/crf/src
139.5 creating build/temp.linux-aarch64-cpython-310/crfsuite/swig
139.5 creating build/temp.linux-aarch64-cpython-310/liblbfgs
139.5 creating build/temp.linux-aarch64-cpython-310/liblbfgs/lib
139.5 creating build/temp.linux-aarch64-cpython-310/pycrfsuite
139.5 gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -Icrfsuite/include/ -Icrfsuite/lib/cqdb/include -Iliblbfgs/include -Ipycrfsuite -I/usr/local/include/python3.10 -c -std=c99 crfsuite/lib/cqdb/src/cqdb.c -o build/temp.linux-aarch64-cpython-310/crfsuite/lib/cqdb/src/cqdb.o
139.5 error: command 'gcc' failed: No such file or directory
139.5 [end of output]
139.5
139.5 note: This error originates from a subprocess, and is likely not a problem with pip.
139.5 error: legacy-install-failure
139.5
139.5 × Encountered error while trying to install package.
139.5 ╰─> python-crfsuite
139.5
139.5 note: This is an issue with the package mentioned above, not pip.
139.5 hint: See above for output from the failure.
141.0
141.0 [notice] A new release of pip is available: 23.0.1 -> 24.1.1
141.0 [notice] To update, run: pip install --upgrade pip

---

failed to solve: process "/bin/sh -c pip install --no-cache-dir txtsplit torch torchaudio cached_path transformers==4.27.4 mecab-python3==1.0.5 num2words==0.5.12 unidic_lite unidic mecab-python3==1.0.5 pykakasi==2.2.1 fugashi==1.3.0 g2p_en==2.1.0 anyascii==0.3.2 jamo==0.4.1 gruut[de,es,fr]==2.2.3 g2pkk>=0.1.1 librosa==0.9.1 pydub==0.25.1 eng_to_ipa==0.0.2 inflect==7.0.0 unidecode==1.3.7 pypinyin==0.50.0 cn2an==0.5.22 jieba==0.42.1 langid==1.1.6 tqdm tensorboard==2.16.2 loguru==0.7.2" did not complete successfully: exit code: 1
`

Thanks for your support,

[prateeksachan]

thanks @acastry for reporting this. Will debug and get it fixed.

[prateeksachan]

hey @acastry did you try deploying this in GPU-based instance? melo_server and whisper_server require GPU instances as mentioned in their docker config.

https://github.com/bolna-ai/bolna/blob/aafb2133ce2f1b9a837c57eb2b8e3efb7e643833/examples/whisper-melo-llama3/docker-compose.yml#L68-L82