Skip to content

Commit 47be785

Browse files
22quinnskyloevil
authored andcommitted
[CI/Build] Disable flaky test_structured_output tests (vllm-project#24404)
Signed-off-by: 22quinn <[email protected]>
1 parent 598f01c commit 47be785

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

tests/v1/entrypoints/llm/test_struct_output_generate.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -46,12 +46,12 @@
4646
("mistralai/Ministral-8B-Instruct-2410", "xgrammar", "mistral", None),
4747
("Qwen/Qwen2.5-1.5B-Instruct", "xgrammar", "auto", None),
4848
("Qwen/Qwen2.5-1.5B-Instruct", "lm-format-enforcer", "auto", None),
49-
("mistralai/Ministral-8B-Instruct-2410", "outlines", "auto", None),
50-
("mistralai/Ministral-8B-Instruct-2410", "outlines", "mistral", None),
49+
#FIXME: This tests are flaky on CI thus disabled. Tracking in Issue #24402
50+
# ("mistralai/Ministral-8B-Instruct-2410", "outlines", "auto", None),
51+
# ("mistralai/Ministral-8B-Instruct-2410", "outlines", "mistral", None),
52+
#("Qwen/Qwen2.5-1.5B-Instruct", "guidance", "auto"),
5153
("mistralai/Ministral-8B-Instruct-2410", "outlines", "auto",
5254
NGRAM_SPEC_CONFIG),
53-
#FIXME: This test is flaky on CI thus disabled
54-
#("Qwen/Qwen2.5-1.5B-Instruct", "guidance", "auto"),
5555
("mistralai/Ministral-8B-Instruct-2410", "guidance", "auto",
5656
NGRAM_SPEC_CONFIG),
5757
("Qwen/Qwen2.5-1.5B-Instruct", "xgrammar", "auto", NGRAM_SPEC_CONFIG),

0 commit comments

Comments
 (0)