Skip to content

Conversation

mudler
Copy link
Owner

@mudler mudler commented Aug 12, 2025

Description

This PR:

Notes for Reviewers

Currently WIP

What works:

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Aug 12, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit a4bdaab
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/68a81144786af50008a84e7b
😎 Deploy Preview https://deploy-preview-6049--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

yamllint Failed

Show Output
::group::backend/index.yaml
::warning file=backend/index.yaml,line=95,col=6::95:6 [comments] missing starting space in comment
::error file=backend/index.yaml,line=140,col=24::140:24 [trailing-spaces] trailing spaces
::warning file=backend/index.yaml,line=723,col=6::723:6 [comments] missing starting space in comment
::warning file=backend/index.yaml,line=928,col=3::928:3 [comments-indentation] comment not indented like content
::endgroup::

Workflow: Yamllint GitHub Actions, Action: __karancode_yamllint-github-action_2, Lint: backend

@mudler
Copy link
Owner Author

mudler commented Aug 21, 2025

due to Blaizzy/mlx-vlm#470 mlx-vlm installed here is behind and does not support many new models, but this is a start!

@mudler
Copy link
Owner Author

mudler commented Aug 21, 2025

arg, more failures as it's a really old version. we might need to drop the mlx-vlm from this PR for now

mudler added 13 commits August 21, 2025 23:46
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
Signed-off-by: Ettore Di Giacinto <[email protected]>
@mudler mudler changed the title feat(mlx): add mlx and mlx-vlm backends feat(mlx): add mlx backends Aug 21, 2025
@mudler mudler changed the title feat(mlx): add mlx backends feat(mlx): add mlx backend Aug 21, 2025
@mudler mudler marked this pull request as ready for review August 21, 2025 21:49
Signed-off-by: Ettore Di Giacinto <[email protected]>
@mudler mudler merged commit 1d830ce into master Aug 22, 2025
68 of 70 checks passed
@mudler mudler deleted the feat/mlx branch August 22, 2025 06:42
This was referenced Aug 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Mlx backend Backend: MLX Using mlx for apple silicon
1 participant