Skip to content

[Bugfix] Fix transformers verison conflict #1627

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

Potabk
Copy link
Contributor

@Potabk Potabk commented Jul 4, 2025

What this PR does / why we need it?

Fix transformers verison conflict, fix #1470

Does this PR introduce any user-facing change?

How was this patch tested?

Signed-off-by: wangli <wangli858794774@gmail.com>
@Potabk
Copy link
Contributor Author

Potabk commented Jul 4, 2025

With this dependency constraints, we can see the transformers uninstalled and re-installed automatically, bellow is some installation log:

ooking in indexes: https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple, https://mirrors.huaweicloud.com/ascend/repos/pypi
Obtaining file:///root/workspace/wl/code/vllm-ascend
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Collecting cmake>=3.26 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/45/ee/750dae28fa12493052c44f744affbfeff0f35a526b4346bd86050e9903e5/cmake-4.0.3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (27.3 MB)
Collecting decorator (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/4e/8c/f3147f5c4b73e7550fe5f9352eaa956ae838d5c51eb58e7a25b9f3e2643b/decorator-5.2.1-py3-none-any.whl (9.2 kB)
Requirement already satisfied: einops in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.8.1)
Collecting numpy<2.0.0 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/fc/a5/4beee6488160798683eed5bdb7eead455892c3b4e1f78d79d8d3f3b084ac/numpy-1.26.4-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (14.2 MB)
Requirement already satisfied: packaging in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (25.0)
Requirement already satisfied: pip in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (25.1)
Collecting pybind11 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/13/2f/0f24b288e2ce56f51c920137620b4434a38fd80583dbbe24fc2a1656c388/pybind11-2.13.6-py3-none-any.whl (243 kB)
Requirement already satisfied: pyyaml in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (6.0.2)
Requirement already satisfied: scipy in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (1.15.3)
Requirement already satisfied: setuptools>=64 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (78.1.1)
Collecting setuptools-scm>=8 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/ab/ac/8f96ba9b4cfe3e4ea201f23f4f97165862395e9331a424ed325ae37024a8/setuptools_scm-8.3.1-py3-none-any.whl (43 kB)
Requirement already satisfied: torch>=2.5.1 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2.7.1)
Collecting torchvision<0.21.0 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/f7/ce/4c31e9b96cc4f9fec746b258d2aa35f8d1247f4f58d63f9c505ea5eb254d/torchvision-0.20.1-cp310-cp310-manylinux2014_aarch64.whl (14.3 MB)
Requirement already satisfied: wheel in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.45.1)
Collecting msgpack (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/e8/c5/df5d6c1c39856bc55f800bf82778fd4c11370667f9b9e9d51b2f5da88f20/msgpack-1.1.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (402 kB)
Collecting quart (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/7e/e9/cc28f21f52913adf333f653b9e0a3bf9cb223f5083a26422968ba73edd8d/quart-0.20.0-py3-none-any.whl (77 kB)
Collecting numba (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/e3/27/797b2004745c92955470c73c82f0e300cf033c791f45bdecb4b33b12bdea/numba-0.61.2-cp310-cp310-manylinux_2_28_aarch64.whl (3.5 MB)
Collecting torch-npu==2.5.1.post1.dev20250619 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.huaweicloud.com/ascend/repos/pypi/torch-npu/torch_npu-2.5.1.post1.dev20250619-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (15.8 MB)
Collecting transformers<4.53.0,>=4.52.4 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/96/f2/25b27b396af03d5b64e61976b14f7209e2939e9e806c10749b6d277c273e/transformers-4.52.4-py3-none-any.whl (10.5 MB)
Collecting torch>=2.5.1 (from vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/69/f0/46e74e0d145f43fa506cb336eaefb2d240547e4ce1f496e442711093ab25/torch-2.5.1-cp310-cp310-manylinux2014_aarch64.whl (91.9 MB)
Requirement already satisfied: filelock in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.18.0)
Requirement already satisfied: typing-extensions>=4.8.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (4.14.0)
Requirement already satisfied: networkx in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.4.2)
Requirement already satisfied: jinja2 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.1.6)
Requirement already satisfied: fsspec in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2025.5.1)
Collecting sympy==1.13.1 (from torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/b2/fe/81695a1aa331a842b582453b605175f419fe8540355886031328089d840a/sympy-1.13.1-py3-none-any.whl (6.2 MB)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from sympy==1.13.1->torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (1.3.0)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from torchvision<0.21.0->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (11.3.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.30.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.33.2)
Requirement already satisfied: regex!=2019.12.17 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2024.11.6)
Requirement already satisfied: requests in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2.32.4)
Requirement already satisfied: tokenizers<0.22,>=0.21 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.21.2)
Requirement already satisfied: safetensors>=0.4.3 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.5.3)
Requirement already satisfied: tqdm>=4.27 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (4.67.1)
Requirement already satisfied: hf-xet<2.0.0,>=1.1.2 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.30.0->transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (1.1.5)
Collecting tomli>=1 (from setuptools-scm>=8->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/6e/c2/61d3e0f47e2b74ef40a68b9e6ad5984f6241a942f7cd3bbfbdbd03861ea9/tomli-2.2.1-py3-none-any.whl (14 kB)
Requirement already satisfied: MarkupSafe>=2.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from jinja2->torch>=2.5.1->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.0.2)
Collecting llvmlite<0.45,>=0.44.0dev0 (from numba->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/30/1c/9366b29ab050a726af13ebaae8d0dff00c3c58562261c79c635ad4f5eb71/llvmlite-0.44.0-cp310-cp310-manylinux_2_27_aarch64.manylinux_2_28_aarch64.whl (41.2 MB)
Collecting aiofiles (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/a5/45/30bb92d442636f570cb5651bc661f52b610e2eec3f891a5dc3a4c3667db0/aiofiles-24.1.0-py3-none-any.whl (15 kB)
Collecting blinker>=1.6 (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/10/cb/f2ad4230dc2eb1a74edf38f1a38b9b52277f75bef262d8908e60d957e13c/blinker-1.9.0-py3-none-any.whl (8.5 kB)
Requirement already satisfied: click>=8.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (8.2.1)
Collecting flask>=3.0 (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/3d/68/9d4508e893976286d2ead7f8f571314af6c2037af34853a30fd769c02e9d/flask-3.1.1-py3-none-any.whl (103 kB)
Collecting hypercorn>=0.11.2 (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/0e/3b/dfa13a8d96aa24e40ea74a975a9906cfdc2ab2f4e3b498862a57052f04eb/hypercorn-0.17.3-py3-none-any.whl (61 kB)
Collecting itsdangerous (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/04/96/92447566d16df59b2a776c0fb82dbc4d9e07cd95062562af01e408583fc4/itsdangerous-2.2.0-py3-none-any.whl (16 kB)
Collecting werkzeug>=3.0 (from quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/52/24/ab44c871b0f07f491e5d2ad12c9bd7358e527510618cb1b803a88e986db1/werkzeug-3.1.3-py3-none-any.whl (224 kB)
Requirement already satisfied: exceptiongroup>=1.1.0 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (1.3.0)
Requirement already satisfied: h11 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (0.16.0)
Collecting h2>=3.1.0 (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/d0/9e/984486f2d0a0bd2b024bf4bc1c62688fcafa9e61991f041fb0e2def4a982/h2-4.2.0-py3-none-any.whl (60 kB)
Collecting priority (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/5e/5f/82c8074f7e84978129347c2c6ec8b6c59f3584ff1a20bc3c940a3e061790/priority-2.0.0-py3-none-any.whl (8.9 kB)
Collecting taskgroup (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/d1/b1/74babcc824a57904e919f3af16d86c08b524c0691504baf038ef2d7f655c/taskgroup-0.2.2-py2.py3-none-any.whl (14 kB)
Collecting wsproto>=0.14.0 (from hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/78/58/e860788190eba3bcce367f74d29c4675466ce8dddfba85f7827588416f01/wsproto-1.2.0-py3-none-any.whl (24 kB)
Collecting hyperframe<7,>=6.1 (from h2>=3.1.0->hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/48/30/47d0bf6072f7252e6521f3447ccfa40b421b6824517f82854703d0f5a98b/hyperframe-6.1.0-py3-none-any.whl (13 kB)
Collecting hpack<5,>=4.1 (from h2>=3.1.0->hypercorn>=0.11.2->quart->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704)
  Using cached https://mirrors.tuna.tsinghua.edu.cn/pypi/web/packages/07/c6/80c95b1b2b94682a72cbdbfb85b81ae2daffa4291fbfa1b1464502ede10d/hpack-4.1.0-py3-none-any.whl (34 kB)
Requirement already satisfied: charset_normalizer<4,>=2 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from requests->transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.4.2)
Requirement already satisfied: idna<4,>=2.5 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from requests->transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from requests->transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2.5.0)
Requirement already satisfied: certifi>=2017.4.17 in /root/cmq/miniconda3/envs/wl/lib/python3.10/site-packages (from requests->transformers<4.53.0,>=4.52.4->vllm_ascend==0.9.1rc2.dev73+g4e91018.d20250704) (2025.6.15)
Building wheels for collected packages: vllm_ascend
  Building editable for vllm_ascend (pyproject.toml) ... done
  Created wheel for vllm_ascend: filename=vllm_ascend-0.9.1rc2.dev73+g4e91018.d20250704-0.editable-cp310-cp310-linux_aarch64.whl size=9998 sha256=ee10d28ad16819da84d2d1bff00fd90b570959f2c4ec625aa2effae6ce868be9
  Stored in directory: /tmp/pip-ephem-wheel-cache-3ac8_1td/wheels/7a/6f/77/64f01c936e1681b10fe3e25b194ef6fa995d2764b878f1cdd4
Successfully built vllm_ascend
Installing collected packages: wsproto, werkzeug, tomli, sympy, pybind11, priority, numpy, msgpack, llvmlite, itsdangerous, hyperframe, hpack, decorator, cmake, blinker, aiofiles, torch, taskgroup, setuptools-scm, numba, h2, flask, torchvision, torch-npu, hypercorn, transformers, quart, vllm_ascend
  Attempting uninstall: sympy
    Found existing installation: sympy 1.14.0
    Uninstalling sympy-1.14.0:
      Successfully uninstalled sympy-1.14.0
  Attempting uninstall: numpy
    Found existing installation: numpy 2.2.6
    Uninstalling numpy-2.2.6:
      Successfully uninstalled numpy-2.2.6
  Attempting uninstall: torch
    Found existing installation: torch 2.7.1
    Uninstalling torch-2.7.1:
      Successfully uninstalled torch-2.7.1
  Attempting uninstall: transformers
    Found existing installation: transformers 4.53.1
    Uninstalling transformers-4.53.1:
      Successfully uninstalled transformers-4.53.1
  Attempting uninstall: vllm_ascend
    Found existing installation: vllm_ascend 0.9.1rc2.dev73+g4e91018
    Can't uninstall 'vllm_ascend'. No files were found to uninstall.
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
schedule-search 0.0.1 requires absl-py, which is not installed.
te 0.4.0 requires ml-dtypes, which is not installed.
te 0.4.0 requires tornado, which is not installed.
Successfully installed aiofiles-24.1.0 blinker-1.9.0 cmake-4.0.3 decorator-5.2.1 flask-3.1.1 h2-4.2.0 hpack-4.1.0 hypercorn-0.17.3 hyperframe-6.1.0 itsdangerous-2.2.0 llvmlite-0.44.0 msgpack-1.1.1 numba-0.61.2 numpy-1.26.4 priority-2.0.0 pybind11-2.13.6 quart-0.20.0 setuptools-scm-8.3.1 sympy-1.13.1 taskgroup-0.2.2 tomli-2.2.1 torch-2.5.1 torch-npu-2.5.1.post1.dev20250619 torchvision-0.20.1 transformers-4.52.4 vllm_ascend-0.9.1rc2.dev73+g4e91018.d20250704 werkzeug-3.1.3 wsproto-1.2.0

Copy link

codecov bot commented Jul 4, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 52.36%. Comparing base (c30ddb8) to head (71f09d1).
Report is 75 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1627       +/-   ##
===========================================
+ Coverage   27.39%   52.36%   +24.96%     
===========================================
  Files          56       78       +22     
  Lines        6191     9631     +3440     
===========================================
+ Hits         1696     5043     +3347     
- Misses       4495     4588       +93     
Flag Coverage Δ
unittests 52.36% <ø> (+24.96%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@MengqingCao
Copy link
Collaborator

I think we can move pip install -e . before pip install -r requirements-dev.txt to check this on CI

@Potabk
Copy link
Contributor Author

Potabk commented Jul 4, 2025

I think we can move pip install -e . before pip install -r requirements-dev.txt to check this on CI

make sense

Signed-off-by: wangli <wangli858794774@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

TypeError: Qwen2_5_VLProcessor.__init__() got multiple values for argument 'image_processor'
2 participants