-
-
Notifications
You must be signed in to change notification settings - Fork 86
Open
Description
Qwen3-Embedding-0.6B-Q8_0.gguf starts and works as expected, while any other ones I've tried either give an error (LLM/LLM.swift:44: Fatal error: Unexpectedly found nil while unwrapping an Optional value)
or an array with only zeros (vector).
Now I do it like this:
guard let modelURL = Bundle.main.url(forResource: "paraphrase-multilingual-mpnet-base-277M-v2-Q8_0", withExtension: "gguf") else {
print("Model file not found")
return
}
self.bot = LLM(from: modelURL)
Perhaps there are some initialization features?
Metadata
Metadata
Assignees
Labels
No labels