[Installation]: There is an error installing vllm from Git source. #13048
Description
Your current environment
Ubuntu 24.04 LTS (6.8.0-41-generic)
ROCM 6.3.0
Dual GPUs AMD Radeon 7900XTX
There is an error installing vllm from Git source.
I have tested many Vllm releases, usually never had any problems. But today a strange error occurred. Vllm does not install.
How you are installing vllm
git clone https://github.com/vllm-project/vllm.git
cd vllm
DOCKER_BUILDKIT=1 docker build --build-arg BASE_IMAGE="rocm/vllm-dev:navi_nightly" -f Dockerfile.rocm -t vllm-rocm .
[+] Building 135.3s (22/24) docker:default
=> [internal] load build definition from Dockerfile.rocm 0.0s
=> => transferring dockerfile: 3.95kB 0.0s
=> [internal] load metadata for docker.io/rocm/vllm-dev:navi_base 0.5s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 387B 0.0s
=> [base 1/5] FROM docker.io/rocm/vllm-dev:navi_base@sha256:65ec84298875a6024988f5698101952ac822d73ad0cbcb0f7e1ac9b8b8d0a168 0.0s
=> [internal] load build context 0.1s
=> => transferring context: 129.90kB 0.1s
=> CACHED [base 2/5] RUN apt-get update -q -y && apt-get install -q -y sqlite3 libsqlite3-dev libfmt-dev libmsgpack-dev libsuitesparse-dev 0.0s
=> CACHED [base 3/5] RUN python3 -m pip install --upgrade pip && pip install setuptools_scm 0.0s
=> CACHED [base 4/5] RUN apt-get purge -y sccache; python3 -m pip uninstall -y sccache; rm -f "$(which sccache)" 0.0s
=> CACHED [base 5/5] WORKDIR /app 0.0s
=> CACHED COPY ./ vllm/ 0.0s
=> [build_vllm 1/1] RUN cd vllm && python3 -m pip install -r requirements-rocm.txt && python3 setup.py clean --all && if [ 0 -eq "1" ]; then python3 setup_cyt 80.1s
=> [export_vllm 1/6] COPY --from=build_vllm /app/vllm/dist/*.whl / 0.0s
=> [export_vllm 2/6] COPY --from=build_vllm /app/vllm/requirements*.txt / 0.1s
=> [export_vllm 3/6] COPY --from=build_vllm /app/vllm/benchmarks /benchmarks 0.0s
=> [export_vllm 4/6] COPY --from=build_vllm /app/vllm/tests /tests 0.1s
=> [export_vllm 5/6] COPY --from=build_vllm /app/vllm/examples /examples 0.1s
=> [export_vllm 6/6] COPY --from=build_vllm /app/vllm/.buildkite /.buildkite 0.0s
=> CACHED [final 1/7] RUN python3 -m pip install --upgrade pip && rm -rf /var/lib/apt/lists/* 0.0s
=> CACHED [final 2/7] RUN case "$(which python3)" in *"/opt/conda/envs/py_3.9"*) rm -rf /opt/conda/envs/py_3.9/lib/python3.9/site-packages/numpy-1.20.3. 0.0s
=> CACHED [final 3/7] RUN python3 -m pip install --upgrade huggingface-hub[cli] 0.0s
=> CACHED [final 4/7] RUN if [ 1 -eq "1" ]; then git clone -b nvtx_enabled https://github.com/ROCm/rocmProfileData.git && cd rocmProfileData/rpd_tracer && pip i 0.0s
=> ERROR [final 5/7] RUN --mount=type=bind,from=export_vllm,src=/,target=/install cd /install && pip install -U -r requirements-rocm.txt && pip uninstall -y vl 52.0s
------
> [final 5/7] RUN --mount=type=bind,from=export_vllm,src=/,target=/install cd /install && pip install -U -r requirements-rocm.txt && pip uninstall -y vllm && pip install *.whl:
0.411 DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/HipMarker-1.0-py3.12-linux-x86_64.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at https://github.com/pypa/pip/issues/12330
0.411 DEPRECATION: Loading egg at /usr/local/lib/python3.12/dist-packages/rpdTracer-1.0-py3.12.egg is deprecated. pip 25.1 will enforce this behaviour change. A possible replacement is to use pip for package installation. Discussion can be found at https://github.com/pypa/pip/issues/12330
0.414 Ignoring fastapi: markers 'python_version < "3.9"' don't match your environment
...
...
...
...
51.26 Requirement already satisfied: einops in /usr/local/lib/python3.12/dist-packages (from vllm==0.7.3.dev57+g2ae88905.d20250210) (0.8.1)
51.26 Requirement already satisfied: compressed-tensors==0.9.1 in /usr/local/lib/python3.12/dist-packages (from vllm==0.7.3.dev57+g2ae88905.d20250210) (0.9.1)
51.26 Requirement already satisfied: depyf==0.18.0 in /usr/local/lib/python3.12/dist-packages (from vllm==0.7.3.dev57+g2ae88905.d20250210) (0.18.0)
51.26 Requirement already satisfied: cloudpickle in /usr/local/lib/python3.12/dist-packages (from vllm==0.7.3.dev57+g2ae88905.d20250210) (3.1.1)
51.41 INFO: pip is looking at multiple versions of vllm to determine which version is compatible with other requirements. This could take a while.
51.41 ERROR: Could not find a version that satisfies the requirement torch==2.5.1+cpu; platform_machine != "ppc64le" and platform_machine != "aarch64" and platform_system != "Darwin" (from vllm) (from versions: 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.6.0)
51.44
51.44 [notice] A new release of pip is available: 25.0 -> 25.0.1
51.44 [notice] To update, run: python3 -m pip install --upgrade pip
51.44 ERROR: No matching distribution found for torch==2.5.1+cpu; platform_machine != "ppc64le" and platform_machine != "aarch64" and platform_system != "Darwin"
------
Dockerfile.rocm:100
--------------------
99 | # Install vLLM
100 | >>> RUN --mount=type=bind,from=export_vllm,src=/,target=/install \
101 | >>> cd /install \
102 | >>> && pip install -U -r requirements-rocm.txt \
103 | >>> && pip uninstall -y vllm \
104 | >>> && pip install *.whl
105 |
--------------------
ERROR: failed to solve: process "/bin/sh -c cd /install && pip install -U -r requirements-rocm.txt && pip uninstall -y vllm && pip install *.whl" did not complete successfully: exit code: 1
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.