-
-
Notifications
You must be signed in to change notification settings - Fork 10.4k
Closed
vllm-project/vllm-ascend
#2969Labels
actionableThere is clear action for a vLLM developer to takeThere is clear action for a vLLM developer to takebugSomething isn't workingSomething isn't workingtorch.compile
Description
🚀 The feature, motivation and pitch
vLLM doesn't work without fullgraph=True Dynamo, so we should just delete it. The deletion might be a little tricky because there are some other libraries that use this function: https://github.com/search?q=repo%3Avllm-project%2Fvllm-ascend%20VLLM_TEST_DYNAMO_FULLGRAPH_CAPTURE&type=code, so we'd need to figure out what matters and delete those first.
"Bug" because "VLLM_TEST_DYNAMO_FULLGRAPH_CAPTURE=0" may not do anything
Alternatives
Keep it around forever
Additional context
n/a
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Metadata
Metadata
Assignees
Labels
actionableThere is clear action for a vLLM developer to takeThere is clear action for a vLLM developer to takebugSomething isn't workingSomething isn't workingtorch.compile
Type
Projects
Status
Done