Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: ggml-org/llama.cpp
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master@{1day}
Choose a base ref
...
head repository: ggml-org/llama.cpp
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
  • 5 commits
  • 13 files changed
  • 4 contributors

Commits on May 17, 2025

  1. vulkan: use scalar FA rather than coopmat2 when N==1 (#13554)

    @jeffbolznv
    jeffbolznv authored May 17, 2025
    Configuration menu
    Copy the full SHA
    4f41ee1 View commit details
    Browse the repository at this point in the history

  2. vulkan: move common FA code to flash_attn_base.comp (#13556) 

    * vulkan: move common FA code to flash_attn_base.comp

* vulkan: move common FA index/stride setup code to flash_attn_base.comp

* build fix
    @jeffbolznv
    jeffbolznv authored May 17, 2025
    Configuration menu
    Copy the full SHA
    2f5a4e1 View commit details
    Browse the repository at this point in the history

  3. parallel : add option for non-shared and larger prompts (#13598) 

    * parallel : add option for non-shared and larger prompts

* parallel : update readme [no ci]

* cont : add note about base models [no ci]

* parallel : better var name

ggml-ci
    @ggerganov
    ggerganov authored May 17, 2025
    Configuration menu
    Copy the full SHA
    518329b View commit details
    Browse the repository at this point in the history

  4. cmake: use the current build config for vulkan-shaders-gen (#13595) 

    * fix: use the current build config for `vulkan-shaders-gen`

* fix: only pass a valid build type to `--config`
    @giladgd
    giladgd authored May 17, 2025
    Configuration menu
    Copy the full SHA
    e3a7cf6 View commit details
    Browse the repository at this point in the history

  5. server : added --no-prefill-assistant flag (#13608) 

    * added no-prefill-assistant flag

* reworded documentation comment

* updated server README.md
    @isaac-mcfadyen
    isaac-mcfadyen authored May 17, 2025
    Configuration menu
    Copy the full SHA
    6a2bc8b View commit details
    Browse the repository at this point in the history
Loading