1 Release published by 1 person

• v2.29.0

  published May 12, 2025

28 Pull requests merged by 5 people

• chore: ⬆️ Update ggml-org/whisper.cpp to d1f114da61b1ae1e70b03104fad42c9dd666feeb

  #5381 merged May 17, 2025

• fix(flux): Set CFG=1 so that prompts are followed

  #5378 merged May 16, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 20a20decd94badfd519a07ea91f0bba8b8fc4dea

  #5374 merged May 16, 2025

• fix: typos

  #5376 merged May 16, 2025

• chore(model gallery): add primeintellect_intellect-2

  #5373 merged May 15, 2025

• chore(model gallery): add thedrummer_rivermind-lux-12b-v1

  #5372 merged May 15, 2025

• chore(model gallery): add thedrummer_snowpiercer-15b-v1

  #5371 merged May 15, 2025

• chore(model gallery): add skywork_skywork-or1-7b

  #5370 merged May 15, 2025

• chore(model gallery): add skywork_skywork-or1-32b

  #5369 merged May 15, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to f389d7e3e56bbbfec49fd333551927a0fcbb7213

  #5367 merged May 15, 2025

• chore(docs/install.sh): image changes

  #5354 merged May 14, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to f89056057511a1657af90bb28ef3f21e5b1f33cd

  #5364 merged May 14, 2025

• docs: ⬆️ update docs version mudler/LocalAI

  #5363 merged May 14, 2025

• fix(ci): tag latest against cpu-only image

  #5362 merged May 13, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to de4c07f93783a1a96456a44dc16b9db538ee1618

  #5358 merged May 13, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to e41bc5c61ae66af6be2bd7011769bb821a83e8ae

  #5357 merged May 13, 2025

• chore(deps): bump securego/gosec from 2.22.3 to 2.22.4

  #5356 merged May 12, 2025

• chore(deps): bump dependabot/fetch-metadata from 2.3.0 to 2.4.0

  #5355 merged May 12, 2025

• chore(ci): strip 'core' in the image suffix, identify python-based images with 'extras'

  #5353 merged May 12, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 9a390c4829cd3058d26a2e2c09d16e3fd12bf1b1

  #5351 merged May 12, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 2e310b841e0b4e7cf00890b53411dd9f8578f243

  #4785 merged May 12, 2025

• chore(model gallery): add qwen_qwen2.5-vl-72b-instruct

  #5349 merged May 11, 2025

• chore(model gallery): add qwen_qwen2.5-vl-7b-instruct

  #5348 merged May 11, 2025

• chore(model gallery): add gryphe_pantheon-proto-rp-1.8-30b-a3b

  #5347 merged May 11, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 15e6125a397f6086c1dfdf7584acdb7c730313dc

  #5345 merged May 11, 2025

• chore(model-gallery): ⬆️ update checksum

  #5346 merged May 10, 2025

• feat(whisper.cpp): gpu support

  #5344 merged May 10, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 33eff4024084d1f0c8441b79f7208a52fad79858

  #5343 merged May 10, 2025

2 Pull requests opened by 2 people

• chore: :arrow_up: Update ggml-org/llama.cpp to `6aa892ec2aa7fe0c93e87c4b970d83a942fb9454`

  #5365 opened May 13, 2025

• feat(llama.cpp): upgrade and use libmtmd

  #5379 opened May 16, 2025

3 Issues closed by 3 people

• Problems with all Flux-Models

  #5366 closed May 16, 2025

• LocalAI v2.28 does not use the ENV file in docker.

  #5280 closed May 14, 2025

• GPU support for stablediffusion-ggml backend

  #5350 closed May 11, 2025

5 Issues opened by 5 people

• Error when transcribing an audio file

  #5380 opened May 16, 2025

• Realtime transcription API and VAD

  #5377 opened May 16, 2025

• SmolVLM Support

  #5368 opened May 14, 2025

• Feature Request: Expose Model Internal Reasoning States (logits, attention, token-level trace)

  #5360 opened May 13, 2025

• Hierarchical Model LRU/ARC and Manual Reclaim

  #5352 opened May 12, 2025

7 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Macos install problem

  #5230 commented on May 10, 2025 • 0 new comments

• Method to unload model(s) would be very useful.

  #3632 commented on May 11, 2025 • 0 new comments

• Inferencing not working with P2P in latest version.

  #3968 commented on May 13, 2025 • 0 new comments

• Docker: no NVIDIA driver on your system for /image/generations API due to CUDA 12.8 required by RTX5000

  #5189 commented on May 13, 2025 • 0 new comments

• can never get by: "localai" error="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:43369: connect: connection refused\""

  #5339 commented on May 16, 2025 • 0 new comments

• chore: :arrow_up: Update PABannier/bark.cpp to `5d5be84f089ab9ea53b7a793f088d3fbf7247495`

  #4786 commented on May 16, 2025 • 0 new comments

• chore: :arrow_up: Update leejet/stable-diffusion.cpp to `10c6501bd05a697e014f1bee3a84e5664290c489`

  #4925 commented on May 16, 2025 • 0 new comments