Skip to content

Conversation

mudler
Copy link
Owner

@mudler mudler commented Aug 22, 2023

Description

This PR syncs up the llama backend to use gguf (go-skynet/go-llama.cpp#180). It also adds llama-stable to the targets so we can still load ggml. It adapts the current tests to use the llama-backend for ggml and uses a gguf model to run tests on the new backend.

In order to consume the new version of go-llama.cpp, it also bump go to 1.21 (images, pipelines, etc)

Signed-off-by: Ettore Di Giacinto <[email protected]>
@mudler mudler merged commit 1120847 into master Aug 23, 2023
@mudler mudler deleted the gguf branch August 23, 2023 23:18
@mudler
Copy link
Owner Author

mudler commented Aug 23, 2023

let's see how it goes!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant