MPT support in llama.cpp#3417

Merged

ggerganov merged 17 commits intoggml-org:masterfrom

Oct 10, 2023

Commits on Sep 30, 2023

CUDA: added support for ggml_clamp (see also: https://github.com/ggerganov/ggml/issues/545)
jploski
committed
mpt : added an implementation based (mostly) on falcon integration, modified with deltas from ggml/examples/mpt
jploski
committed
mpt : protect against "clip_qkv": null in mpt-7b
jploski
committed
mpt : quick fix to avoid "Strange model" warning when quantizing MPT models
jploski
committed
mpt : addendum to changeset:84e30e8 - leave parameter clamp_kqv out from metadata rather than use 0.0 to indicate "no clamping" (more compliant with the current GGUF spec?)
jploski
committed
mpt : standardized all tensor names to follow GGUF spec
jploski
committed
mpt : addendum to changeset:1be89c40 - use "req" parameter of GGUF_GET_KEY macro instead of duplicate code
jploski
committed

Commits on Oct 2, 2023

Commits on Oct 3, 2023

mpt : removed ne01 + n_past == ne00 assertion from alibi (cuda/f32) and rope_shift from build_mpt
jploski
committed

Commits on Oct 10, 2023