[Bug]: Qwen2.5-VL Cannot Output Correct Content under 0.8.1

[MotorBottle]

Your current environment

vllm0.8.1 docker

🐛 Describe the bug

Same machine same setup, 0.7.3 works well. But on 0.8.1 the bbox output and obeject detection became 100% not usable. Don't know what the cause is. But a temp fix is to downgrade to 0.7.3

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

cc @Isotr0py

[Isotr0py]

@MotorBottle Can you check if #15200 fixed this? I think most of qwen2.5-vl incorrectness issue in 0.8.0/0.8.1 is caused by same issue.

[MotorBottle]

@MotorBottle Can you check if #15200 fixed this? I think most of qwen2.5-vl incorrectness issue in 0.8.0/0.8.1 is caused by same issue.

Will do later today