Support Qwen VL

[thesby]

Could you please support Qwen VL model

[Boomboomdunce]

Hope to increase the support of Qwen VL

[thiner]

This is really a must have model for Chinese users, as it's the SOTA of vision model which can recognize Chinese characters. But I think that won't be easy, because there is not GGUF format model yet on HuggingFace.

[thesby]

There is a int4 model. https://huggingface.co/Qwen/Qwen-VL-Chat-Int4

[thiner]

@thesby ollama runs GGUF models only currently. Pytorch or safetensors model need to be converted to gguf firstly. https://github.com/ollama/ollama/blob/main/docs/import.md. But convert Qwen-VL to gguf format is not supported by llama.cpp yet.

[monkeycc]

Hope to increase the support of Qwen VL +1

hope + 1

[TKasperczyk]

+1

[leo985]

+1

[wangqinghuan]

+1

[J0eky]

+1

[liyanshuai2018]

This multimodal model is really great, supported, and it is recommended to adapt

[BayMikyou]

+1

[meloseven]

+1

[bobbyng626]

+1