Pass Scheduler Config for VLM Pipeline in WhoWhatBenchmark.

[popovaan]

No description provided.

[Copilot]

Pull Request Overview

This PR enhances the OpenVINO GenAI visual-text pipeline by allowing a continuous-batching configuration (cb_config) to be passed and applied via the new scheduler API. Function signatures for load_visual_text_genai_pipeline, load_visual_text_model, and the top-level load_model dispatcher were extended to accept and forward arbitrary kwargs.

• Add cb_config handling and create SchedulerConfig when provided
• Update pipeline instantiation to use scheduler_config and set ATTENTION_BACKEND
• Propagate **kwargs through load_visual_text_model and load_model

Comments suppressed due to low confidence (3)

tools/who_what_benchmark/whowhatbench/model_loaders.py:219

• This function now accepts cb_config within kwargs, but there’s no docstring describing it. Please add or update the docstring to explain the cb_config parameter, its expected structure, and how it controls continuous batching.

def load_visual_text_genai_pipeline(model_dir, device="CPU", ov_config=None, **kwargs):

tools/who_what_benchmark/whowhatbench/model_loaders.py:226

• [nitpick] The key cb_config is a bit ambiguous—consider renaming it to scheduler_config or batching_config for clarity and consistency with get_scheduler_config_genai.

    is_continuous_batching = kwargs.get("cb_config", None) is not None

tools/who_what_benchmark/whowhatbench/model_loaders.py:226

• The new continuous-batching code path isn’t covered by existing tests. Please add unit tests for when cb_config is provided and verify that scheduler_config is applied correctly.

    is_continuous_batching = kwargs.get("cb_config", None) is not None

[Copilot]

Passing the exception as a separate argument may not include stack trace in all logging setups. Consider using logger.exception(...) or logger.error(..., exc_info=True) to ensure the error details are captured.

Suggested change

	logger.error("Failed to import openvino_genai package. Please install it. Details:\n", e)
	logger.error("Failed to import openvino_genai package. Please install it. Details:\n", exc_info=True)